00000100:00100000:0.0F:1779690345.236192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0F:1779690345.236271:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503539840 00000100:00100000:3.0:1779690345.236287:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503539840 00000100:00100000:3.0:1779690345.236369:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1779690345.236379:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:97589:x1866137503539840:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690345.236403:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1779690345.236408:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690345.236473:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913d9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed73e expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.236537:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.236551:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.236563:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690345.236921:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:3.0:1779690345.236926:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 95 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690345.237011:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.237048:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913d9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed73e expref: 19 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.237064:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed73e expref: 18 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.237082:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:3.0:1779690345.237085:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690345.237089:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4a00, rc 0) 00000100:00100000:3.0:1779690345.237151:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+18:97589:x1866137503539840:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 774us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690345.237159:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1779690345.239401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0F:1779690345.240988:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503539968 00000100:00100000:1.0:1779690345.241013:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503539968 00000100:00100000:1.0:1779690345.241081:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:1.0:1779690345.241093:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+18:97589:x1866137503539968:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690345.241113:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690345.241132:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913d9da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed745 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241196:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241212:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241223:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241237:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241243:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241250:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241676:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f800/0xb4bb873a1913d9ef lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241687:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f800/0xb4bb873a1913d9ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241694:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f800/0xb4bb873a1913d9ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690345.241790:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x71:0x0]: returning size 7680 00000004:00200000:1.0:1779690345.241794:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690345.241983:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f800/0xb4bb873a1913d9ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.241997:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242004:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242011:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242016:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690345.242020:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242028:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242040:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:1.0:1779690345.242043:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690345.242047:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242053:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913d9e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242065:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242082:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242364:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242370:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690345.242373:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242380:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242388:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91ed45de (ffff9e2f903c9a00) 00010000:00010000:1.0:1779690345.242391:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690345.242393:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242399:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913d9e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242435:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913d9da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed745 expref: 20 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242449:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f800/0xb4bb873a1913d9ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed745 expref: 19 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.242456:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:1.0:1779690345.242458:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690345.242470:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f800, rc 0) 00000100:00100000:1.0:1779690345.242651:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:97589:x1866137503539968:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1560us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690345.242660:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:1.0:1779690345.251928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690345.252107:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540096 00000100:00100000:3.0:1779690345.252117:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540096 00000100:00100000:3.0:1779690345.252210:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:3.0:1779690345.252221:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:97589:x1866137503540096:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690345.252241:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690345.252262:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913d9f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed74c expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252341:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252356:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252368:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252385:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252392:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252399:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252766:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252784:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252791:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690345.252861:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00000004:00200000:3.0:1779690345.252866:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690345.252885:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252896:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252905:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252912:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252918:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252924:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690345.252928:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252935:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252947:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:3.0:1779690345.252956:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690345.252962:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252969:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913d9fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252981:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252987:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252993:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.252998:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690345.253001:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253007:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253015:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x3800fa7 (ffff9e2f883cbe00) 00010000:00010000:3.0:1779690345.253017:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690345.253020:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253025:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da04 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253058:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913d9f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 21 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253080:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 20 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.253087:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690345.253089:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690345.253092:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282000, rc 0) 00000100:00100000:3.0:1779690345.253159:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+20:97589:x1866137503540096:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 941us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690345.253167:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:0.0:1779690345.257140:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690345.257216:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540224 00000100:00100000:1.0:1779690345.257226:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540224 00000100:00100000:1.0:1779690345.257311:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6352 00000100:00100000:1.0:1779690345.257323:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503540224:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690345.257340:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690345.257358:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089a9a751/0xb4bb873a1913da12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed753 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690345.257417:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492288384:192.168.203.5@tcp:106: 00000100:00100000:1.0:1779690345.257507:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308133ac00 going to sleep for 11 seconds 00000100:00080000:0.0:1779690345.257646:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1779690345.259114:0:6581:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1e5:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1779690345.259123:0:6581:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1e5:0x0] updating lvb mtime: 0 -> 1779690343 00002000:00010000:3.0:1779690345.259126:0:6581:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1e5:0x0] updating lvb atime: 0 -> 1779690343 00002000:00010000:3.0:1779690345.259128:0:6581:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1e5:0x0] updating lvb ctime: 0 -> 1779690343 00002000:00010000:3.0:1779690345.259143:0:6581:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1e5:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:3.0:1779690345.259154:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492288384:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690345.259193:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089a9a751/0xb4bb873a1913da12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed753 expref: 13 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.259217:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089a9a751/0xb4bb873a1913da12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed753 expref: 13 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.259231:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00100000:3.0:1779690345.259286:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503540224:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1965us (2154us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690345.259314:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6352 00000100:00100000:1.0:1779690345.269892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690345.269977:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540352 00000100:00100000:0.0:1779690345.269988:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540352 00000100:00100000:0.0:1779690345.270043:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 238 00000100:00100000:0.0:1779690345.270054:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+20:97589:x1866137503540352:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690345.270075:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690345.270093:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913da19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed75a expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270159:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270173:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270184:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690345.270382:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x71:0x0]: returning size 7680 00000004:00200000:0.0:1779690345.270387:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690345.270469:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270497:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913da19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 22 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270512:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 21 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.270530:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:0.0:1779690345.270532:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690345.270536:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d200, rc 0) 00000100:00100000:0.0:1779690345.270591:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+21:97589:x1866137503540352:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 539us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690345.270598:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 238 00000100:00100000:0.0:1779690345.275577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690345.275654:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540480 00000100:00100000:3.0:1779690345.275664:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540480 00000100:00100000:3.0:1779690345.275717:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6353 00000100:00100000:3.0:1779690345.275727:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503540480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690345.275746:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690345.275775:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c56de49/0xb4bb873a1913da27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed761 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690345.275860:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492288512:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690345.275942:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1779690345.281237:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492288512:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690345.281295:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c56de49/0xb4bb873a1913da27 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed761 expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.281335:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c56de49/0xb4bb873a1913da27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed761 expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.281347:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:3.0:1779690345.281409:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503540480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 5683us (5838us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690345.281417:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6353 00000100:00100000:1.0:1779690345.290747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690345.291615:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540736 00000100:00100000:0.0:1779690345.291625:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540736 00000100:00100000:0.0:1779690345.291677:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:0.0:1779690345.291686:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:97589:x1866137503540736:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1779690345.292068:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].9, 136 off9416 00000100:00100000:0.0:1779690345.292148:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:97589:x1866137503540736:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 462us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690345.292156:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 239 00000001:00100000:2.0F:1779690345.472697:0:6605:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000040:00080000:2.0:1779690345.933128:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690345.933135:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690345.933195:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 10 count 9 00000040:00080000:2.0:1779690345.933203:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690345.933559:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492288640:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690345.933656:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30850bd0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1779690345.933718:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690345.937307:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492288640:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690345.939855:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690345.939952:0:57571:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540864 00000100:00100000:1.0:1779690345.939961:0:57571:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540864 00000100:00100000:1.0:1779690345.940069:0:57571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1779690345.940080:0:57571:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+10:97603:x1866137503540864:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1779690345.940150:0:57571:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+10:97603:x1866137503540864:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690345.940157:0:57571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00080000:0.0:1779690345.940270:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690345.943931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690345.944110:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503540992 00000100:00100000:3.0:1779690345.944120:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503540992 00000100:00100000:3.0:1779690345.944216:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00100000:3.0:1779690345.944249:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+10:97603:x1866137503540992:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690345.944283:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690345.944395:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+10:97603:x1866137503540992:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 158us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690345.944402:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00100000:1.0:1779690345.954872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690345.954911:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503541248 00000100:00100000:1.0:1779690345.954920:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503541248 00000100:00100000:1.0:1779690345.954980:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00100000:1.0:1779690345.954991:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+10:97603:x1866137503541248:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690345.955012:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690345.955033:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913da2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed768 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.955204:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.955219:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.955231:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690345.955242:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00010000:00010000:1.0:1779690345.955433:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913da2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 13 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.955450:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 12 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.955460:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:1.0:1779690345.955463:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690345.955468:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e000, rc 0) 00000100:00100000:1.0:1779690345.955537:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503541248:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 547us (674us total) trans 12884902006 rc 0/0 00000100:00100000:1.0:1779690345.955545:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00100000:3.0:1779690345.968784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690345.968898:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503541376 00000100:00100000:0.0:1779690345.968908:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503541376 00000100:00100000:0.0:1779690345.968984:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6354 00000100:00100000:0.0:1779690345.968996:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503541376:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690345.969049:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.969070:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 21 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.969089:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690345.969091:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690345.969095:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.969133:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 21 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690345.969146:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 21 pid: 49882 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690345.969162:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492288768:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690345.969257:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089bba900 going to sleep for 11 seconds 00000100:00080000:2.0:1779690345.969448:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690345.973449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690345.973520:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492288768:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690345.973545:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690345.973916:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503541504 00000100:00100000:3.0:1779690345.973924:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503541504 00010000:00010000:3.0:1779690345.973974:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 22 pid: 49882 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690345.974109:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3187 00000100:00100000:3.0:1779690345.974118:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+22:2392:x1866137503541504:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690345.974132:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690345.974204:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 22 pid: 49882 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.974218:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 22 pid: 49882 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.974242:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a1913d932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6c0 expref: 22 pid: 49882 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.974256:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690345.974258:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690345.974263:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690345.974271:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690345.974282:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690345.974334:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690345.974383:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503541504:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 266us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690345.974391:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3187 00010000:00010000:1.0:1779690345.974470:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974480:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974513:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974522:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974530:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974537:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690345.974541:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974551:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974580:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.974588:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004db13c43/0xb4bb873a1913da43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690345.974652:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503541376:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 5658us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690345.974660:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6354 00000100:00100000:1.0:1779690345.979416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690345.984094:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503541760 00000100:00100000:3.0:1779690345.984109:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503541760 00000100:00100000:3.0:1779690345.984234:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 242 00000100:00100000:3.0:1779690345.984247:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503541760:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690345.984384:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503541760:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 141us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690345.984392:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 242 00000100:00100000:0.0:1779690345.991512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690345.991601:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503541888 00000100:00100000:1.0:1779690345.991611:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503541888 00000100:00100000:1.0:1779690345.991670:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6355 00000100:00100000:1.0:1779690345.991680:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2391:x1866137503541888:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690345.991699:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690345.991721:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed76f expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690345.991748:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x6a13eb67, atime: 0x0, ctime: 0x6a13eb67, blocks: 0x803 00010000:00010000:1.0:1779690345.991768:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690345.991770:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690345.991779:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.991796:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690345.991853:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f000, rc 0) 00000100:00100000:1.0:1779690345.991913:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2391:x1866137503541888:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 234us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690345.991919:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6355 00000100:00100000:0.0:1779690346.012334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690346.014585:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542144 00000100:00100000:1.0:1779690346.014664:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542144 00000100:00100000:1.0:1779690346.015387:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 243 00000100:00100000:1.0:1779690346.015401:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503542144:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690346.015986:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503542144:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 587us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690346.015995:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 243 00000100:00100000:0.0:1779690346.024527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690346.024709:0:37918:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542272 00000100:00100000:3.0:1779690346.024718:0:37918:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542272 00002000:00100000:3.0:1779690346.024766:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1e5:0x0] (0->1048575) req@ffff9e2f8f152d80 x1866137503542272/t0(0) o3->4e142dd6-2774-4e7c-aac6-3ec8711f37a2@192.168.203.5@tcp:582/0 lens 488/0 e 0 to 0 dl 1779690357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690346.024777:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f152d80 with x1866137503542272 ext(0->1048575) 00002000:00010000:3.0:1779690346.024782:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8f152d80 00000100:00100000:3.0:1779690346.025068:0:37918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2041 00000100:00100000:3.0:1779690346.025078:0:37918:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2389:x1866137503542272:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1779690346.058041:0:37918:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2389:x1866137503542272:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 32955us (33513us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1779690346.058053:0:37918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2041 00002000:00100000:1.0:1779690346.058066:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1e5:0x0] (0->1048575) req@ffff9e2f8f152d80 x1866137503542272/t0(0) o3->4e142dd6-2774-4e7c-aac6-3ec8711f37a2@192.168.203.5@tcp:582/0 lens 488/440 e 0 to 0 dl 1779690357 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690346.058076:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f152d80 with x1866137503542272 ext(0->1048575) 00002000:00010000:1.0:1779690346.058082:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8f152d80 00000040:00080000:1.0:1779690346.085628:0:61491:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690346.085638:0:61491:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690346.085704:0:61491:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 10 count 9 00000040:00080000:1.0:1779690346.085712:0:61491:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690346.095713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690346.095925:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542400 00000100:00100000:0.0:1779690346.095934:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542400 00000100:00100000:0.0:1779690346.095986:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:0.0:1779690346.095996:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97603:x1866137503542400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690346.096016:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690346.096036:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913da51 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed776 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096069:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096088:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096100:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096190:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913da51 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 14 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096207:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 13 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690346.096216:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:0.0:1779690346.096219:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690346.096222:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c400, rc 0) 00000100:00100000:0.0:1779690346.096281:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503542400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 287us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690346.096288:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:0.0:1779690346.113433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690346.113630:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542528 00000100:00100000:2.0:1779690346.113640:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542528 00000100:00100000:2.0:1779690346.113693:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:2.0:1779690346.113703:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503542528:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690346.113732:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690346.113895:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503542528:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 192us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690346.113902:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:2.0:1779690346.118907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690346.119015:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542656 00000100:00100000:3.0:1779690346.119034:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542656 00000100:00100000:3.0:1779690346.119139:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6356 00000100:00100000:3.0:1779690346.119149:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2390:x1866137503542656:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690346.119192:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119209:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690346.119211:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690346.119215:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119229:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119258:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119267:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119275:0:40949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119282:0:40949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690346.119286:0:40949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119319:0:40949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119334:0:40949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.119342:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913da5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690346.119404:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2390:x1866137503542656:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 256us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690346.119411:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6356 00000100:00100000:1.0:1779690346.142964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690346.143025:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503542912 00000100:00100000:3.0:1779690346.143034:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503542912 00000100:00100000:3.0:1779690346.143086:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 246 00000100:00100000:3.0:1779690346.143095:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503542912:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690346.143164:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.143180:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 13 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.143191:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.143222:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 13 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.143245:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 13 pid: 57585 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690346.143260:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492288896:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690346.143354:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690346.148141:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492288896:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690346.148184:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690346.148563:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690346.152793:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543040 00000100:00100000:3.0:1779690346.152877:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543040 00010000:00010000:3.0:1779690346.152916:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 14 pid: 57585 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690346.153058:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3188 00000100:00100000:3.0:1779690346.153070:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:2392:x1866137503543040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690346.153085:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690346.153091:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 14 pid: 57585 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153105:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 14 pid: 57585 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153128:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913da58 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed776 expref: 14 pid: 57585 timeout: 3173 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153141:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690346.153146:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153166:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153173:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153209:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690346.153264:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:2392:x1866137503543040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 196us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690346.153271:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3188 00010000:00010000:3.0:1779690346.153866:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.153875:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154150:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154159:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154165:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154171:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690346.154175:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154182:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154202:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690346.154204:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690346.154209:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690346.154215:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da66 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690346.154352:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503542912:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 11256us (11393us total) trans 12884902007 rc 0/0 00000100:00100000:3.0:1779690346.154360:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 246 00000040:00080000:2.0:1779690346.155247:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690346.155254:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690346.156014:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:2.0:1779690346.156023:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690346.159290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690346.159377:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543296 00000100:00100000:3.0:1779690346.159387:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543296 00000100:00100000:3.0:1779690346.159449:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1779690346.159460:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97603:x1866137503543296:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690346.159844:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:97603:x1866137503543296:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 385us (560us total) trans 12884902008 rc 0/0 00000100:00100000:3.0:1779690346.159853:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1779690346.441209:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492289024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690346.441278:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690346.441713:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289024 00000100:00100000:3.0:1779690346.441722:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289024 00000100:00100000:3.0:1779690346.441782:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1779690346.441790:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492289024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690346.441849:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 744554496 pending 0 free 3829399552 avail 3827302400 00000100:00100000:3.0:1779690346.441916:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492289024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690346.441925:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1779690346.441948:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492289280:0@lo:400:kworker.0 00000100:00100000:3.0:1779690346.441983:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492289152:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.441990:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690346.442016:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690346.442025:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492289408:0@lo:400:kworker.0 00000100:00100000:3.0:1779690346.442029:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690346.442061:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690346.442067:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492289664:0@lo:400:kworker.0 00000100:00100000:3.0:1779690346.442098:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690346.442098:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289280 00000100:00100000:0.0:1779690346.442110:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289280 00000100:00100000:3.0:1779690346.442119:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690346.442126:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492289536:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.442148:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289408 00000100:00100000:0.0:1779690346.442152:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289408 00000100:00100000:3.0:1779690346.442157:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690346.442172:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289664 00000100:00100000:0.0:1779690346.442176:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289664 00000100:00100000:3.0:1779690346.442196:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1779690346.442205:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690346.442251:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492289280:12345-0@lo:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00080000:1.0:1779690346.442272:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690346.442277:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690346.442301:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289152 00000100:00100000:1.0:1779690346.442361:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289152 00000100:00100000:1.0:1779690346.442396:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1779690346.442403:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690346.442519:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492289152:12345-0@lo:400:kworker.0 Request processed in 115us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690346.442526:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1779690346.444626:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1779690346.444661:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492289408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.444744:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492289408:12345-0@lo:400:kworker.0 Request processed in 107us (2684us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690346.444753:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1779690346.444784:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1779690346.444790:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.444849:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492289664:12345-0@lo:400:kworker.0 Request processed in 59us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690346.444855:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1779690346.445909:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492289792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690346.445960:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690346.446016:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492289408:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.446029:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492289280:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.446106:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492289024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690346.446138:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492289152:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.446149:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492289664:0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.446193:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289792 00000100:00100000:0.0:1779690346.446200:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289792 00000100:00100000:0.0:1779690346.446253:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1779690346.446274:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492289792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690346.446315:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 623575040 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690346.446355:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492289792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690346.446362:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1779690346.446392:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492289792:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1779690346.446428:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690346.446447:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492289536 00000100:00100000:0.0:1779690346.446450:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492289536 00000100:00100000:0.0:1779690346.446731:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1779690346.446740:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492289536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690346.446779:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492289536:12345-0@lo:400:kworker.0 Request processed in 40us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690346.446785:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1779690346.446894:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492289536:0@lo:400:kworker.0 00000100:00100000:3.0:1779690346.448398:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1779690346.955020:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690347.783272:0:61542:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690347.783290:0:61542:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690347.783369:0:61542:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 10 count 9 00000040:00080000:0.0:1779690347.783374:0:61542:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690347.841949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690347.842273:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543424 00000100:00100000:0.0:1779690347.842292:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543424 00000100:00100000:0.0:1779690347.842354:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6357 00000100:00100000:0.0:1779690347.842364:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503543424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690347.842380:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690347.842399:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed77d expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.842435:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690347.842437:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690347.842445:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.842463:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.842477:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d000, rc 0) 00000100:00100000:0.0:1779690347.842525:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+13:2391:x1866137503543424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 164us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690347.842532:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6357 00000100:00080000:1.0:1779690347.842747:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690347.850502:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690347.850571:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543680 00000100:00100000:3.0:1779690347.850579:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543680 00000100:00100000:3.0:1779690347.850651:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:3.0:1779690347.850662:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+21:97613:x1866137503543680:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690347.850682:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690347.850702:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da74 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed784 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.850842:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.850858:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.850872:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690347.850894:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00010000:00010000:3.0:1779690347.851037:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da74 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed784 expref: 24 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690347.851098:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690347.851451:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed784 expref: 23 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.851462:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690347.851465:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690347.851469:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:3.0:1779690347.851535:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+23:97613:x1866137503543680:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 876us (1040us total) trans 12884902009 rc 0/0 00000100:00100000:3.0:1779690347.851543:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:0.0:1779690347.857555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690347.860247:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543808 00000100:00100000:1.0:1779690347.860260:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543808 00000100:00100000:1.0:1779690347.860374:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6358 00000100:00100000:1.0:1779690347.860396:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+13:2389:x1866137503543808:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:1.0:1779690347.860439:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860459:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860469:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860492:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690347.860494:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690347.860498:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860532:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860546:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 13 pid: 6582 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.860561:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492289920:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690347.860660:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.860670:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 6 pid: 6583 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.860679:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492290048:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690347.860701:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381000 going to sleep for 11 seconds 00000100:00100000:2.0:1779690347.866384:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492289920:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690347.866398:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492290048:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690347.866426:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690347.867235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690347.867265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690347.867339:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503543936 00000100:00100000:1.0:1779690347.867347:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503543936 00010000:00010000:1.0:1779690347.867383:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 14 pid: 6582 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.867432:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544064 00000100:00100000:1.0:1779690347.867436:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544064 00010000:00010000:1.0:1779690347.867461:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.867483:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3189 00000100:00100000:1.0:1779690347.867493:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2392:x1866137503543936:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690347.867507:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690347.867529:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 14 pid: 6582 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867542:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 14 pid: 6582 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867563:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913da6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed77d expref: 14 pid: 6582 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867581:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690347.867631:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2392:x1866137503543936:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690347.867638:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3189 00000100:00100000:1.0:1779690347.867655:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3190 00000100:00100000:1.0:1779690347.867662:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2392:x1866137503544064:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690347.867676:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690347.867684:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867695:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867708:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddc77d8b/0xb4bb873a1913da4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed76f expref: 7 pid: 6583 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.867719:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690347.867721:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690347.867725:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.868516:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.870466:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690347.870524:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503544064:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2857us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690347.870536:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3190 00000100:00080000:1.0:1779690347.870582:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1779690347.872646:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872663:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872700:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872709:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872717:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872724:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690347.872738:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872761:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872779:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.872786:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913da89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690347.872890:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503543808:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 12503us (15340us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690347.872901:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6358 00000100:00100000:2.0:1779690347.878740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690347.880038:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544320 00000100:00100000:0.0:1779690347.880050:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544320 00000100:00100000:0.0:1779690347.880110:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1779690347.880119:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+23:97613:x1866137503544320:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:0.0:1779690347.880182:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed784 expref: 23 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690347.880485:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902010 00000001:00080000:0.0:1779690347.883309:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902011 00010000:00010000:0.0:1779690347.883425:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883454:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 22 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883462:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 26 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883469:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 13 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883476:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 6/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883519:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 13 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883534:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 13 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690347.883548:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290176:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690347.883657:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 26 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.883667:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 26 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690347.883676:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290304:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690347.883719:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 22 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.884008:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 22 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690347.884020:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290432:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690347.884055:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1000 going to sleep for 11 seconds 00000100:00100000:0.0:1779690347.891106:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290176:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690347.891121:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290304:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690347.891631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690347.891981:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544448 00000100:00100000:3.0:1779690347.891989:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544448 00010000:00010000:3.0:1779690347.892026:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 27 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690347.892110:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3191 00000100:00100000:3.0:1779690347.892121:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+27:2392:x1866137503544448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690347.892136:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690347.892154:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 27 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.892165:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 27 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.892201:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1913da0b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed74c expref: 27 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.892217:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690347.892221:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.892230:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.892237:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690347.892304:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+26:2392:x1866137503544448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 185us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690347.892312:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3191 00000100:00100000:3.0:1779690347.895476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690347.895540:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544576 00000100:00100000:1.0:1779690347.895551:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544576 00010000:00010000:1.0:1779690347.895608:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 14 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.895656:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3192 00000100:00100000:1.0:1779690347.895666:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:2392:x1866137503544576:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690347.895681:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690347.895687:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 14 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.895700:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 14 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.895724:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913da35 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed768 expref: 14 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.895740:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:1.0:1779690347.895746:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.895755:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.895763:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1779690347.895783:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690347.895839:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:2392:x1866137503544576:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 173us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690347.895847:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3192 00000100:00100000:2.0:1779690347.896880:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492290432:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690347.896911:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690347.900775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690347.900849:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544704 00000100:00100000:3.0:1779690347.900858:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544704 00000100:00080000:0.0:1779690347.900895:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690347.900910:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 23 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690347.900947:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3193 00000100:00100000:3.0:1779690347.900956:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+23:2392:x1866137503544704:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690347.900969:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690347.900975:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 23 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901001:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 23 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901034:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913d924 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6b9 expref: 23 pid: 57561 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901048:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690347.901053:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901063:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901071:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.901112:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690347.901168:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+22:2392:x1866137503544704:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690347.901176:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3193 00010000:00010000:2.0:1779690347.901409:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.901418:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1779690347.901539:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902012 00000001:00080000:2.0:1779690347.901759:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902013 00000001:00080000:2.0:1779690347.901853:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902014 00000100:00100000:2.0:1779690347.901935:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492290560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690347.902036:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690347.902070:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089bbad80 going to sleep for 11 seconds 00000100:00100000:3.0:1779690347.902103:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492290560 00000100:00100000:3.0:1779690347.902108:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492290560 00000100:00100000:3.0:1779690347.902146:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1779690347.902154:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492290560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690347.902233:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492290560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690347.902240:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:2.0:1779690347.902260:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492290560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1779690347.902895:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902015 00000100:00100000:2.0:1779690347.902949:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492290688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690347.902983:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690347.903332:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8b845a80 going to sleep for 11 seconds 00000100:00100000:3.0:1779690347.904325:0:40938:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492290688 00000100:00100000:3.0:1779690347.904334:0:40938:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492290688 00000100:00100000:3.0:1779690347.904482:0:40938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:3.0:1779690347.904492:0:40938:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492290688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690347.904778:0:40938:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492290688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 287us (1793us total) trans 4294968401 rc 0/0 00000100:00100000:3.0:1779690347.904786:0:40938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:1.0:1779690347.905026:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492290688:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:1.0:1779690347.905054:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905071:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905079:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905085:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690347.905090:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905097:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905112:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:1.0:1779690347.905115:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1779690347.905119:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690347.905124:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913da90 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690347.905472:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x72:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1779690347.905618:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].4, 64 off8472 00000004:00080000:1.0:1779690347.905629:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3075479823163ns, next at 3076479821198ns, rc = 0 00000001:00080000:1.0:1779690347.905637:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902016 00010000:00010000:1.0:1779690347.905691:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:1.0:1779690347.905695:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1779690347.905701:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913da7b lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed784 expref: 30 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690347.905838:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+29:97613:x1866137503544320:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 25719us (27106us total) trans 12884902017 rc 0/0 00000100:00100000:1.0:1779690347.905848:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000020:00080000:1.0:1779690347.905853:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1779690347.931951:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690347.932535:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503544960 00000100:00100000:3.0:1779690347.932544:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503544960 00000100:00100000:3.0:1779690347.932605:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 248 00000100:00100000:3.0:1779690347.932616:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+29:97616:x1866137503544960:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690347.932650:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690347.932667:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913da97 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed78b expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932731:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932745:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932756:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932939:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932947:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690347.932968:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933654:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933665:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933673:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690347.933683:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00010000:00010000:2.0:1779690347.933767:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933776:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933783:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.933788:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690347.933798:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934438:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934462:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:2.0:1779690347.934465:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690347.934470:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934475:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913da9e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934488:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934494:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934499:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934505:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690347.934508:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934513:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934520:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x3800fa7 (ffff9e2f883cbe00) 00010000:00010000:2.0:1779690347.934522:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690347.934533:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934538:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913daa5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934585:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913da97 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 32 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934599:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 31 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690347.934606:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:2.0:1779690347.934608:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690347.934610:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812aca00, rc 0) 00000100:00100000:2.0:1779690347.934681:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+31:97616:x1866137503544960:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2067us (2736us total) trans 12884902018 rc 0/0 00000100:00100000:2.0:1779690347.934689:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 248 00000100:00100000:3.0:1779690347.937255:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690347.937938:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545088 00000100:00100000:0.0:1779690347.937948:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545088 00000100:00100000:0.0:1779690347.938004:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:0.0:1779690347.938013:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:97616:x1866137503545088:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1779690347.938072:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938089:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938100:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938123:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938130:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938144:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938150:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690347.938154:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938161:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938172:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690347.938175:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690347.938179:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690347.938186:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913daba lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690347.938253:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:97616:x1866137503545088:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 242us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690347.938261:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:3.0:1779690347.942651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690347.942695:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545344 00000100:00100000:2.0:1779690347.942705:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545344 00000100:00100000:2.0:1779690347.942789:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:2.0:1779690347.942798:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:97616:x1866137503545344:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690347.943099:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+32:97616:x1866137503545344:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 301us (455us total) trans 12884902019 rc 0/0 00000100:00100000:2.0:1779690347.943107:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00010000:00010000:3.0:1779690347.977066:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690348.022497:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.022647:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545600 00000100:00100000:0.0:1779690348.022657:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545600 00000100:00100000:0.0:1779690348.022719:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00100000:0.0:1779690348.022729:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+32:97622:x1866137503545600:12345-192.168.203.5@tcp:101:multiop.0 00010000:00010000:0.0:1779690348.022752:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.022771:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dac1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed792 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.023694:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.023715:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.023725:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 4/0,1 mode: --/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.023760:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.023773:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 33 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.023786:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492290816:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690348.023896:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381480 going to sleep for 11 seconds 00000100:00100000:2.0:1779690348.030420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.030780:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545728 00000100:00100000:3.0:1779690348.030789:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545728 00010000:00010000:2.0:1779690348.030972:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 34 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.031121:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3194 00000100:00100000:2.0:1779690348.031132:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+34:2391:x1866137503545728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690348.031146:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690348.031157:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 34 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.031171:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 34 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.031192:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:2.0:1779690348.031197:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.031206:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.031211:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.031226:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690348.031267:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+34:2391:x1866137503545728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 138us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690348.031284:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3194 00010000:00010000:1.0:1779690348.031378:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913daac lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed78b expref: 33 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.031396:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492290816:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690348.031420:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.031436:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.031442:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690348.031462:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00010000:00010000:1.0:1779690348.031740:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 34 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.031755:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 33 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.031761:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.031764:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1779690348.031766:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8000, rc 0) 00000100:00100000:1.0:1779690348.031851:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503545600:12345-192.168.203.5@tcp:101:multiop.0 Request processed in 9078us (9317us total) trans 12884902020 rc 0/0 00000100:00100000:1.0:1779690348.031860:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00100000:2.0:1779690348.050232:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.050329:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545856 00000100:00100000:0.0:1779690348.050342:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545856 00000100:00100000:0.0:1779690348.050439:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:0.0:1779690348.050449:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503545856:12345-192.168.203.5@tcp:101:multiop.0 00010000:00010000:0.0:1779690348.050473:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.050491:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913dad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed799 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.050560:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913dad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed799 expref: 34 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.050576:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913dad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed799 expref: 34 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.050604:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690348.050608:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690348.050612:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d800, rc 0) 00000100:00100000:0.0:1779690348.050669:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+34:97622:x1866137503545856:12345-192.168.203.5@tcp:101:multiop.0 Request processed in 222us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.050676:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:3.0:1779690348.054487:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.054569:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.054652:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546240 00000100:00100000:1.0:1779690348.054661:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546240 00000100:00100000:1.0:1779690348.054733:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18637 00000100:00100000:1.0:1779690348.054744:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+34:97622:x1866137503546240:12345-192.168.203.5@tcp:103:multiop.0 00010000:00010000:1.0:1779690348.054758:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690348.054784:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913dad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed799 expref: 34 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.054844:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.054849:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690348.054895:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503546240:12345-192.168.203.5@tcp:103:multiop.0 Request processed in 153us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.054901:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18637 00000100:00100000:0.0:1779690348.055381:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503545984 00000100:00100000:0.0:1779690348.055386:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503545984 00000100:00100000:0.0:1779690348.055427:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 252 00000100:00100000:0.0:1779690348.055436:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+22:97624:x1866137503545984:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:0.0:1779690348.055451:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.055471:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913dadd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7a0 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055527:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055541:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055551:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055565:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055572:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055578:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055953:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055964:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.055972:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 4/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.056002:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.056026:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 32 pid: 57559 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.056041:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492290944:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690348.056168:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1300 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.059895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.060057:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492290944:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690348.060083:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.060165:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546368 00000100:00100000:0.0:1779690348.060172:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546368 00000100:00100000:0.0:1779690348.060226:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 253 00000100:00100000:0.0:1779690348.060235:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503546368:12345-192.168.203.5@tcp:58:multiop.0 00010000:00010000:0.0:1779690348.060327:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.060341:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.060360:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690348.060644:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].10, 136 off9552 00000100:00100000:0.0:1779690348.060729:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503546368:12345-192.168.203.5@tcp:58:multiop.0 Request processed in 494us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.060737:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 253 00000100:00100000:3.0:1779690348.062950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.063048:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546496 00000100:00100000:1.0:1779690348.063056:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546496 00010000:00010000:1.0:1779690348.063095:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 33 pid: 57559 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.063134:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3195 00000100:00100000:1.0:1779690348.063144:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+33:2392:x1866137503546496:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690348.063157:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690348.063162:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 33 pid: 57559 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063175:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 33 pid: 57559 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063196:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913dac8 lrc: 0/0,0 mode: --/CW res: [0x200000bd3:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed792 expref: 33 pid: 57559 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063230:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.063234:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x40 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063243:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063251:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.063288:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690348.063343:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+32:2392:x1866137503546496:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.063357:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3195 00010000:00010000:0.0:1779690348.063834:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063843:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690348.063899:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00000004:00200000:0.0:1779690348.063903:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690348.063942:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063953:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063961:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063968:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063974:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063979:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690348.063982:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063989:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.063999:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:0.0:1779690348.064001:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690348.064005:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064011:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913dae4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064034:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064040:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064046:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064051:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690348.064053:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064060:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064067:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x3800fa7 (ffff9e308bf54f00) 00010000:00010000:0.0:1779690348.064069:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690348.064072:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064077:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913daeb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064117:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913dadd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 24 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064131:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 23 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.064150:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690348.064152:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690348.064155:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690348.064239:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+23:97624:x1866137503545984:12345-192.168.203.5@tcp:101:stat.0 Request processed in 8805us (9761us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.064247:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 252 00000100:00100000:2.0:1779690348.066269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.069191:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546624 00000100:00100000:0.0:1779690348.069206:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546624 00000100:00100000:0.0:1779690348.069324:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 254 00000100:00100000:0.0:1779690348.069334:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+32:97622:x1866137503546624:12345-192.168.203.5@tcp:101:multiop.0 00010000:00010000:0.0:1779690348.069359:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.069380:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7a7 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069433:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069445:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 4/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069464:0:57560:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069478:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069510:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690348.069513:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690348.069518:0:57560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.069526:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c400, rc 0) 00000100:00100000:0.0:1779690348.069594:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+33:97622:x1866137503546624:12345-192.168.203.5@tcp:101:multiop.0 Request processed in 261us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.069602:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 254 00000040:00080000:0.0:1779690348.234622:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690348.234630:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690348.234721:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 11 count 10 00000040:00080000:0.0:1779690348.234728:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690348.234874:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492291072:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690348.235075:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1540 going to sleep for 11 seconds 00000100:00100000:0.0:1779690348.241593:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492291072:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690348.242269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.243112:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546752 00000100:00100000:1.0:1779690348.243123:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546752 00000100:00100000:1.0:1779690348.243187:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:1.0:1779690348.243198:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97625:x1866137503546752:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690348.243243:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690348.243561:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97625:x1866137503546752:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 365us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.243570:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:3.0:1779690348.250516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.250978:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503546880 00000100:00100000:1.0:1779690348.250989:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503546880 00000100:00100000:1.0:1779690348.251054:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 256 00000100:00100000:1.0:1779690348.251065:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97625:x1866137503546880:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1779690348.251150:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251167:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251179:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251194:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251201:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251207:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251229:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251237:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251243:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690348.251287:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00000004:00200000:1.0:1779690348.251292:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690348.251304:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251315:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251328:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251339:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251344:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.251348:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251354:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251366:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690348.251369:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.251374:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251380:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913db07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251394:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251399:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251404:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251409:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.251418:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251424:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251431:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc821ae5c (ffff9e2f903c9600) 00010000:00010000:1.0:1779690348.251433:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.251436:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251442:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc821ae5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251457:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251463:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251468:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251472:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.251475:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251480:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251486:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.251488:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.251498:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.251504:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db15 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.251581:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97625:x1866137503546880:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 518us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.251590:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 256 00000100:00100000:2.0:1779690348.258914:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.259018:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503547136 00000100:00100000:0.0:1779690348.259028:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503547136 00000100:00100000:0.0:1779690348.259071:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 257 00000100:00100000:0.0:1779690348.259080:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:97625:x1866137503547136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.259099:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.259119:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7ae expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259213:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259233:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259244:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690348.259257:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048576 00010000:00010000:0.0:1779690348.259365:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259373:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259380:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259386:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690348.259389:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259396:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259408:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690348.259410:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690348.259415:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259421:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db23 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259481:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db1c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ae expref: 15 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259491:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690348.259494:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690348.259498:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ae expref: 15 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.259507:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483de00, rc 0) 00000100:00100000:0.0:1779690348.259567:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:97625:x1866137503547136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 487us (661us total) trans 12884902021 rc 301/301 00000100:00100000:0.0:1779690348.259575:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 257 00000100:00100000:2.0:1779690348.264969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.266527:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503547264 00000100:00100000:1.0:1779690348.266539:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503547264 00000100:00100000:1.0:1779690348.266611:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 258 00000100:00100000:1.0:1779690348.266623:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:97625:x1866137503547264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690348.266673:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690348.266779:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:97625:x1866137503547264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 159us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.266787:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 258 00000100:00100000:3.0:1779690348.271938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.277006:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503547392 00000100:00100000:0.0:1779690348.277020:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503547392 00000100:00100000:0.0:1779690348.277079:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 259 00000100:00100000:0.0:1779690348.277089:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+14:97625:x1866137503547392:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.277109:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.277129:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7b5 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277199:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277214:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277225:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277258:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277266:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277288:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277635:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277646:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277653:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690348.277738:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x71:0x0]: returning size 7680 00000004:00200000:0.0:1779690348.277742:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690348.277858:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277871:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277877:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277883:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277899:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690348.277903:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277910:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277922:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:0.0:1779690348.277924:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690348.277930:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277936:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277948:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277954:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277959:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277964:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690348.277966:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277971:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277988:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91ed45de (ffff9e308bf54f00) 00010000:00010000:0.0:1779690348.277991:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690348.277994:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.277998:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91ed45de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.278029:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7b5 expref: 16 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.278041:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7b5 expref: 15 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.278048:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:0.0:1779690348.278050:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690348.278052:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c200, rc 0) 00000100:00100000:0.0:1779690348.278108:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+15:97625:x1866137503547392:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1021us (6178us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.278116:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 259 00000100:00100000:2.0:1779690348.282242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.282347:0:57569:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503547520 00000100:00100000:1.0:1779690348.282357:0:57569:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503547520 00000100:00100000:1.0:1779690348.282405:0:57569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1779690348.282416:0:57569:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+15:97625:x1866137503547520:12345-192.168.203.5@tcp:700:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.282499:0:57569:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+15:97625:x1866137503547520:12345-192.168.203.5@tcp:700:lhsmtool_posix.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.282507:0:57569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1779690348.285479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.285564:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503547776 00000100:00100000:1.0:1779690348.285574:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503547776 00000100:00100000:1.0:1779690348.285627:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 260 00000100:00100000:1.0:1779690348.285637:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+15:97625:x1866137503547776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690348.285669:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690348.285689:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db4d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7bc expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.293097:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.293116:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.293133:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690348.293145:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 0 00010000:00010000:1.0:1779690348.293206:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db4d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7bc expref: 18 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.293229:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7bc expref: 17 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.293239:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:1.0:1779690348.293242:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690348.293249:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9e00, rc 0) 00000100:00100000:1.0:1779690348.293337:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+17:97625:x1866137503547776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 7701us (7866us total) trans 12884902022 rc 0/0 00000100:00100000:1.0:1779690348.293346:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 260 00000100:00100000:1.0:1779690348.306357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.306489:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548032 00000100:00100000:0.0:1779690348.306499:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548032 00000100:00100000:0.0:1779690348.306559:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 261 00000100:00100000:0.0:1779690348.306569:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+17:97625:x1866137503548032:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.306632:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690348.306660:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913db54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7bc expref: 17 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.306695:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:0.0:1779690348.306707:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690348.306739:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.306751:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.306759:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.306789:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.306803:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 32 pid: 57585 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.306874:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492291200:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690348.306966:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1000 going to sleep for 11 seconds 00000100:00100000:2.0:1779690348.309335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.309469:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548160 00000100:00100000:3.0:1779690348.309477:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548160 00010000:00010000:3.0:1779690348.309514:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 33 pid: 57585 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690348.309553:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3196 00000100:00100000:3.0:1779690348.309562:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+33:2392:x1866137503548160:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690348.309574:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690348.309580:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 33 pid: 57585 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.309592:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 33 pid: 57585 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.309630:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:3.0:1779690348.309635:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.309642:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.309649:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.309676:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690348.309742:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+33:2392:x1866137503548160:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 180us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.309749:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3196 00010000:00010000:0.0:1779690348.310211:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913da20 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed75a expref: 32 pid: 57585 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.310235:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492291200:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690348.310260:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.310269:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.310300:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.310366:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.310376:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.310384:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310893:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310902:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310908:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310914:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690348.310918:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310925:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310936:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:2.0:1779690348.310939:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690348.310942:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310948:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913db62 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310958:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310963:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310975:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310980:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690348.310982:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310988:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.310995:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0xac318a4b (ffff9e308bf54f00) 00010000:00010000:2.0:1779690348.310997:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690348.311000:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.311005:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db69 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x71:0x0].0xac318a4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.311078:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+16:97625:x1866137503548032:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4511us (4729us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690348.311086:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 261 00000100:00100000:2.0:1779690348.314782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.314920:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548288 00000100:00100000:0.0:1779690348.314930:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548288 00000100:00100000:0.0:1779690348.314987:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 262 00000100:00100000:0.0:1779690348.314998:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+16:97625:x1866137503548288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.315016:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.315038:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db70 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7c3 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315074:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315087:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315098:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315194:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 18 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315220:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 17 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.315228:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:0.0:1779690348.315231:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690348.315235:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c600, rc 0) 00000100:00100000:0.0:1779690348.315315:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+17:97625:x1866137503548288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 319us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.315322:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 262 00000100:00100000:3.0:1779690348.321864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.321958:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548544 00000100:00100000:1.0:1779690348.321968:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548544 00000100:00100000:1.0:1779690348.322049:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 263 00000100:00100000:1.0:1779690348.322060:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+17:97625:x1866137503548544:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690348.322144:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.322160:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.322172:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690348.322390:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003ddc0ead reply state 000000001ec03ff6 transno 12884902023 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.322401:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690348.322507:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97625:x1866137503548544:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 448us (651us total) trans 12884902023 rc 0/0 00000100:00100000:1.0:1779690348.322514:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 263 00010000:00010000:3.0:1779690348.332625:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332643:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332650:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332656:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690348.332660:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332668:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332698:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:3.0:1779690348.332701:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690348.332706:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.332712:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913db7e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690348.334767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.335181:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548672 00000100:00100000:0.0:1779690348.335192:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548672 00000100:00100000:0.0:1779690348.335252:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 264 00000100:00100000:0.0:1779690348.335268:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:97625:x1866137503548672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.335319:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.335341:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7ca expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.335402:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.335417:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.335427:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:0.0:1779690348.335430:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690348.335447:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483da00, rc 0) 00000100:00100000:0.0:1779690348.335512:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97625:x1866137503548672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 250us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.335518:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 264 00000100:00100000:2.0:1779690348.345117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.345212:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503548800 00000100:00100000:1.0:1779690348.345222:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503548800 00000100:00100000:1.0:1779690348.345282:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1779690348.345293:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97625:x1866137503548800:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.345423:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97625:x1866137503548800:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.345438:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:2.0:1779690348.348044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.348224:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503549056 00000100:00100000:1.0:1779690348.348234:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503549056 00000100:00100000:1.0:1779690348.348295:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1779690348.348305:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97625:x1866137503549056:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.348570:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549056:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 266us (531us total) trans 12884902024 rc 0/0 00000100:00100000:1.0:1779690348.348578:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:3.0:1779690348.351339:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.351554:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503549312 00000100:00100000:1.0:1779690348.351563:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503549312 00000100:00100000:1.0:1779690348.351657:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 265 00000100:00100000:1.0:1779690348.351667:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549312:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.351768:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549312:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 104us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.351774:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 265 00000100:00100000:3.0:1779690348.353296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.353398:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503549568 00000100:00100000:0.0:1779690348.353405:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503549568 00000100:00100000:0.0:1779690348.353537:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 266 00000100:00100000:0.0:1779690348.353547:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690348.353565:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.353583:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913db8c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7d1 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.353682:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.353693:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 21 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.353699:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.353724:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 21 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.353735:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 21 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.353749:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492291328:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690348.353867:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1000 going to sleep for 11 seconds 00000100:00100000:2.0:1779690348.358050:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.358115:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503549696 00000100:00100000:0.0:1779690348.358117:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492291328:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690348.358122:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503549696 00010000:00010000:3.0:1779690348.358156:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 22 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690348.358199:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3197 00000100:00100000:3.0:1779690348.358208:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:2392:x1866137503549696:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690348.358221:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690348.358227:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 22 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358240:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 22 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.358270:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358324:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913db85 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ca expref: 22 pid: 57560 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358352:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:3.0:1779690348.358355:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358362:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358369:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.358405:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690348.358536:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.358544:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690348.358563:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 0 00000100:00100000:3.0:1779690348.358590:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+21:2392:x1866137503549696:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 382us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.358597:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3197 00000004:00080000:1.0:1779690348.359769:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e6:0x0], index 0: 0 00010000:00010000:1.0:1779690348.360008:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360016:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360020:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360023:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.360093:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360102:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360116:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:1.0:1779690348.360130:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690348.360135:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360141:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913db93 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360198:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913db8c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7d1 expref: 21 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360208:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:1.0:1779690348.360210:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690348.360213:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913db8c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7d1 expref: 21 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.360223:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d200, rc 0) 00000100:00100000:1.0:1779690348.360315:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6771us (7024us total) trans 12884902025 rc 301/301 00000100:00100000:1.0:1779690348.360321:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 266 00000100:00100000:2.0:1779690348.363020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.363087:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503549952 00000100:00100000:1.0:1779690348.363096:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503549952 00000100:00100000:1.0:1779690348.363150:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1779690348.363160:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+20:97625:x1866137503549952:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.363482:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+21:97625:x1866137503549952:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 323us (469us total) trans 12884902026 rc 0/0 00000100:00100000:1.0:1779690348.363489:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:3.0:1779690348.365331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.365408:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550080 00000100:00100000:2.0:1779690348.365415:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550080 00000100:00100000:2.0:1779690348.365464:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:2.0:1779690348.365486:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+21:97625:x1866137503550080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690348.365508:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690348.365525:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dba1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7d8 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.365584:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.365918:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.365931:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690348.366165:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 0 00000004:00200000:2.0:1779690348.366170:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690348.366189:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.366217:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dba1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7d8 expref: 23 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.366234:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7d8 expref: 22 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.366241:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:2.0:1779690348.366244:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1779690348.366247:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:2.0:1779690348.367051:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:97625:x1866137503550080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1564us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690348.367073:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:2.0:1779690348.369556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.369631:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550208 00000100:00100000:3.0:1779690348.369639:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550208 00000100:00100000:3.0:1779690348.369741:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6359 00000100:00100000:3.0:1779690348.369750:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+5:2391:x1866137503550208:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690348.369766:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690348.369785:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7df expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690348.369837:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690348.369856:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690348.369858:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690348.369866:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 6 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.369894:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 6 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.369906:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4200, rc 0) 00000100:00100000:3.0:1779690348.369954:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2391:x1866137503550208:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 205us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.369968:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6359 00000100:00080000:0.0:1779690348.370210:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690348.371685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.371985:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550464 00000100:00100000:1.0:1779690348.371993:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550464 00000100:00100000:1.0:1779690348.372085:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:1.0:1779690348.372094:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:97625:x1866137503550464:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690348.372263:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:97625:x1866137503550464:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 170us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.372270:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:1.0:1779690348.377681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.378020:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550592 00000100:00100000:3.0:1779690348.378031:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550592 00000100:00100000:3.0:1779690348.378078:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6360 00000100:00100000:3.0:1779690348.378087:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:97625:x1866137503550592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690348.378104:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690348.378123:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7e6 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.378153:0:10273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 7 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.378163:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690348.378165:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690348.378181:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 7 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.378228:0:10273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 7 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.378259:0:10273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 7 pid: 22747 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690348.378284:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492291456:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690348.378380:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.380928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.381002:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550720 00000100:00100000:1.0:1779690348.381004:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492291456:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690348.381009:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550720 00010000:00010000:0.0:1779690348.381039:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 8 pid: 22747 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.381042:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.381059:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5400, rc 0) 00000100:00100000:0.0:1779690348.381078:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3198 00000100:00100000:0.0:1779690348.381086:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2391:x1866137503550720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690348.381098:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690348.381120:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 8 pid: 22747 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.381121:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:97625:x1866137503550592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3035us (3448us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.381128:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6360 00010000:00010000:0.0:1779690348.381132:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 8 pid: 22747 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.381172:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032bf8151/0xb4bb873a1913dbaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7df expref: 7 pid: 22747 timeout: 3175 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.381185:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.381187:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.381192:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 6 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.381202:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 6 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.381236:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 6 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.381248:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492291584:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690348.381309:0:5780:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089fe1540 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.383484:0:5780:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492291584:192.168.203.5@tcp:105: 00010000:00010000:3.0:1779690348.383509:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690348.383565:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2391:x1866137503550720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2478us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.383576:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3198 00000100:00100000:2.0:1779690348.406309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.406460:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550848 00000100:00100000:3.0:1779690348.406470:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550848 00002000:00100000:3.0:1779690348.406518:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1e6:0x0] (0->1048575) req@ffff9e2f8f409f80 x1866137503550848/t0(0) o4->4e142dd6-2774-4e7c-aac6-3ec8711f37a2@192.168.203.5@tcp:584/0 lens 488/0 e 0 to 0 dl 1779690359 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690348.406530:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f409f80 with x1866137503550848 ext(0->1048575) 00002000:00010000:3.0:1779690348.406535:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8f409f80 00000100:00100000:3.0:1779690348.406564:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2042 00000100:00100000:3.0:1779690348.406574:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503550848:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1779690348.444548:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2392:x1866137503550848:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 37965us (38237us total) trans 4294968333 rc 0/0 00000100:00100000:2.0:1779690348.444563:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2042 00002000:00100000:2.0:1779690348.444575:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1e6:0x0] (0->1048575) req@ffff9e2f8f409f80 x1866137503550848/t4294968333(0) o4->4e142dd6-2774-4e7c-aac6-3ec8711f37a2@192.168.203.5@tcp:584/0 lens 488/448 e 0 to 0 dl 1779690359 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690348.444586:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f409f80 with x1866137503550848 ext(0->1048575) 00002000:00010000:2.0:1779690348.444596:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8f409f80 00000100:00100000:1.0:1779690348.450771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.450894:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503550976 00000100:00100000:2.0:1779690348.450904:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503550976 00000100:00100000:2.0:1779690348.450964:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 269 00000100:00100000:2.0:1779690348.450974:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:97625:x1866137503550976:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1779690348.518958:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+22:97625:x1866137503550976:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 67977us (68186us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690348.518970:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 269 00000001:00080000:3.0:1779690348.522256:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902025 is committed 00000001:00080000:3.0:1779690348.522390:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902012 is committed 00000001:00080000:3.0:1779690348.522403:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902026 is committed 00000001:00080000:3.0:1779690348.522415:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902020 is committed 00000004:00080000:3.0:1779690348.522489:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1779690348.522741:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492291712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1779690348.522824:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690348.522893:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492291712 00000100:00100000:0.0:1779690348.522901:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492291712 00000100:00100000:0.0:1779690348.522964:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6361 00000100:00100000:0.0:1779690348.522973:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492291712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1779690348.522996:0:22279:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:485 count 1 00002000:00010000:0.0:1779690348.523026:0:22279:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x6a13eb67, atime: 0x0, ctime: 0x6a13eb67, blocks: 0x803 00010000:00010000:0.0:1779690348.523053:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.523068:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.523070:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.523075:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.523089:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.523099:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.523107:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.523124:0:22279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1779690348.523726:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3319:x1866137492291712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 753us (920us total) trans 4294968402 rc 0/0 00000100:00100000:0.0:1779690348.523735:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6361 00000100:00080000:0.0:1779690348.523762:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1779690348.523797:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f95df1f80/2, rc 0, transno 4294968402 00000100:00100000:0.0:1779690348.523828:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492291712:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1779690348.524874:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690348.524882:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.524894:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690348.524898:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.524923:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.524942:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.524949:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab629f20/0xb4bb873a1913dbbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.524971:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690348.524973:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690348.524975:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1779690348.526170:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f8b845600 refcount 2 committed 0 result 0 batchid 8590018962 00000020:00080000:3.0:1779690348.526179:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088359f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f8b845900 00000020:00080000:3.0:1779690348.526182:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088359d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e30af769c00 00000001:00100000:3.0:1779690348.526216:0:57578:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00080000:3.0:1779690348.526227:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018962 committed batchid 8590018961 00000020:00080000:3.0:1779690348.526474:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018961 00000100:00100000:1.0:1779690348.527605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.529783:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503551104 00000100:00100000:2.0:1779690348.529796:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503551104 00000100:00100000:2.0:1779690348.529909:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6362 00000100:00100000:2.0:1779690348.529919:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2392:x1866137503551104:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00100000:1.0:1779690348.562392:0:7477:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000001:00080000:1.0:1779690348.562411:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968401 is committed 00000100:00100000:1.0:1779690348.573324:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2392:x1866137503551104:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 43397us (45714us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.573336:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6362 00000001:00080000:2.0:1779690348.573468:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968333 is committed 00000100:00100000:0.0:1779690348.576484:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.576573:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503551360 00000100:00100000:2.0:1779690348.576582:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503551360 00000100:00100000:2.0:1779690348.576643:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 270 00000100:00100000:2.0:1779690348.576652:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+11:97625:x1866137503551360:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1779690348.576701:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690348.576738:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dba8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7d8 expref: 11 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.576774:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:2.0:1779690348.576780:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690348.576853:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.576867:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.576875:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690348.577034:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000068f5f7ab reply state 0000000020ba1636 transno 12884902027 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.577044:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690348.577129:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97625:x1866137503551360:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 477us (652us total) trans 12884902027 rc 0/0 00000100:00100000:2.0:1779690348.577136:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 270 00000100:00100000:0.0:1779690348.580786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690348.581065:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581078:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581085:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581091:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ac400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690348.581096:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581103:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581119:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:3.0:1779690348.581123:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690348.581128:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.581134:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dbc4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.581245:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503551488 00000100:00100000:2.0:1779690348.581254:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503551488 00000100:00100000:2.0:1779690348.581343:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:2.0:1779690348.581354:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+11:97625:x1866137503551488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690348.581384:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690348.581399:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7ed expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.581454:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 12 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.581480:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 12 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.581498:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:2.0:1779690348.581501:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690348.581503:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ac600, rc 0) 00000100:00100000:2.0:1779690348.581559:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97625:x1866137503551488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 207us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690348.581566:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:0.0:1779690348.583912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.584056:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503551616 00000100:00100000:1.0:1779690348.584064:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503551616 00000100:00100000:1.0:1779690348.584115:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6363 00000100:00100000:1.0:1779690348.584124:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2391:x1866137503551616:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1779690348.584386:0:15940:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1779690348.584390:0:15940:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb mtime from disk: 0 -> 1779690343 00002000:00010000:1.0:1779690348.584393:0:15940:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb atime from disk: 0 -> 1779690343 00002000:00010000:1.0:1779690348.584395:0:15940:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb ctime from disk: 0 -> 1779690343 00002000:00010000:1.0:1779690348.584397:0:15940:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:1.0:1779690348.584564:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2391:x1866137503551616:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 441us (659us total) trans 4294968334 rc 0/0 00000100:00100000:1.0:1779690348.584573:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6363 00000100:00100000:0.0:1779690348.587294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.587436:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503551872 00000100:00100000:2.0:1779690348.587446:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503551872 00000100:00100000:2.0:1779690348.587500:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:2.0:1779690348.587510:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97625:x1866137503551872:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1779690348.587568:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.587585:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 12 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.587594:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.587626:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 12 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.587640:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 12 pid: 57560 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.587667:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492291840:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690348.587938:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bac43540 going to sleep for 11 seconds 00000100:00100000:2.0:1779690348.591508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.591620:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492291840:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690348.591648:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.592090:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552000 00000100:00100000:1.0:1779690348.592097:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552000 00010000:00010000:1.0:1779690348.592131:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 13 pid: 57560 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.592195:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3199 00000100:00100000:1.0:1779690348.592205:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:2392:x1866137503552000:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690348.592218:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690348.592225:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 13 pid: 57560 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592237:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 13 pid: 57560 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592258:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913db77 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7c3 expref: 13 pid: 57560 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592282:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:1.0:1779690348.592299:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592310:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592318:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.592346:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690348.592459:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592467:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592494:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592501:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592509:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592514:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690348.592518:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592525:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592534:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:2.0:1779690348.592537:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690348.592540:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.592556:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dbd2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.592620:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:97625:x1866137503551872:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 5111us (5332us total) trans 0 rc -22/-22 00000100:00100000:2.0:1779690348.592628:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:1.0:1779690348.593913:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+11:2392:x1866137503552000:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1517us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.593925:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3199 00000100:00100000:2.0:1779690348.596067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.596158:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552128 00000100:00100000:3.0:1779690348.596166:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552128 00000100:00100000:3.0:1779690348.596246:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6364 00000100:00100000:3.0:1779690348.596256:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2391:x1866137503552128:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690348.596306:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.596327:0:40949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 7 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.596336:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690348.596337:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690348.596341:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.596372:0:40949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 7 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.596396:0:40949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 7 pid: 10273 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690348.596410:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492291968:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690348.596503:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1779690348.602661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.602897:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552256 00000100:00100000:0.0:1779690348.602906:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552256 00010000:00010000:0.0:1779690348.602943:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 8 pid: 10273 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.602985:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3200 00000100:00100000:0.0:1779690348.602995:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2391:x1866137503552256:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690348.603009:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1779690348.603010:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492291968:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690348.603043:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 8 pid: 10273 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.603048:0:40949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.603060:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 8 pid: 10273 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.604853:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a04aa21e/0xb4bb873a1913dbb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7e6 expref: 8 pid: 10273 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.604874:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.604876:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690348.604880:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.604889:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.605457:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690348.605526:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+7:2391:x1866137503552256:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2530us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.605537:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3200 00010000:00010000:3.0:1779690348.607049:0:40949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.607067:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607146:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607241:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607254:0:40949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607262:0:40949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690348.607266:0:40949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607286:0:40949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607305:0:40949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.607313:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085b461b4/0xb4bb873a1913dbd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.607444:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2391:x1866137503552128:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 11186us (11379us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.607455:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6364 00000100:00100000:2.0:1779690348.609904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.609963:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552512 00000100:00100000:1.0:1779690348.609972:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552512 00000100:00100000:1.0:1779690348.610029:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:1.0:1779690348.610040:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+11:97625:x1866137503552512:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690348.610114:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610131:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610142:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610410:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610427:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 12 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610436:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610467:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 12 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.610480:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 12 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.610494:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292096:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690348.610579:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381c00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690348.612587:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292096:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690348.612613:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.613395:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.613472:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552640 00000100:00100000:3.0:1779690348.613479:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552640 00010000:00010000:3.0:1779690348.613514:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 13 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.614135:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3201 00000100:00100000:1.0:1779690348.614150:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+13:2392:x1866137503552640:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690348.614166:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690348.614174:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 13 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614189:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 13 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614231:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dbcb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7ed expref: 13 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614248:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:1.0:1779690348.614252:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614260:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614267:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.614310:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690348.614364:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.614371:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+12:2392:x1866137503552640:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 225us (978us total) trans 0 rc 0/0 00010000:00010000:2.0:1779690348.614375:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.614388:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3201 00000001:00080000:2.0:1779690348.614565:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902028 00000001:00080000:2.0:1779690348.614716:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902029 00000001:00080000:2.0:1779690348.615898:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902030 00000100:00100000:2.0:1779690348.615995:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:57559:1866137492292224:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1779690348.616365:0:57559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690348.616397:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848af840 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.616433:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492292224 00000100:00100000:3.0:1779690348.616439:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492292224 00000100:00080000:1.0:1779690348.616488:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690348.616519:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:3.0:1779690348.616529:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57559:x1866137492292224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1779690348.616641:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57559:x1866137492292224:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.616649:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1779690348.616680:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:57559:1866137492292224:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1779690348.617120:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902031 00000100:00100000:1.0:1779690348.617185:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:57559:1866137492292352:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1779690348.617218:0:57559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690348.617249:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.617299:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492292352 00000100:00100000:3.0:1779690348.617304:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492292352 00000100:00100000:3.0:1779690348.617344:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:3.0:1779690348.617352:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57559:x1866137492292352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1779690348.617534:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57559:x1866137492292352:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (314us total) trans 4294968335 rc 0/0 00000100:00100000:3.0:1779690348.617542:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:2.0:1779690348.617657:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:57559:1866137492292352:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1779690348.617735:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902032 00010000:00010000:2.0:1779690348.617765:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617775:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617788:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617794:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690348.617798:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617825:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617842:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:2.0:1779690348.617845:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690348.617850:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617855:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dbe7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617885:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617891:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617897:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617902:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690348.617906:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617921:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617929:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:2.0:1779690348.617931:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690348.617937:0:57559:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617949:0:57559:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.617958:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.618013:0:57559:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c400/0xb4bb873a1913db00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a7 expref: 19 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.618948:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292480:192.168.203.5@tcp:105: 00000100:00100000:2.0:1779690348.619444:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848aff00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690348.626931:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292480:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690348.626960:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.626983:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913daf9 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.627023:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.627094:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 22 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.627104:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.627153:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 22 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.627164:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 22 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.627174:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292608:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690348.627280:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690348.627459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690348.627590:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552768 00000100:00100000:2.0:1779690348.627597:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552768 00000100:00100000:1.0:1779690348.627696:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:1.0:1779690348.627708:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+20:97622:x1866137503552768:12345-192.168.203.5@tcp:49:multiop.0 00000100:00100000:1.0:1779690348.627863:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+20:97622:x1866137503552768:12345-192.168.203.5@tcp:49:multiop.0 Request processed in 158us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.627871:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1779690348.631118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.631190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.631310:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553024 00000100:00100000:0.0:1779690348.631318:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553024 00010000:00010000:0.0:1779690348.631355:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 23 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.631414:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3202 00000100:00100000:0.0:1779690348.631423:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+23:2391:x1866137503553024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690348.631438:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690348.631444:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 23 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.631457:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 23 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.631480:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:0.0:1779690348.631485:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.631495:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.631502:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.631520:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690348.631568:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+23:2391:x1866137503553024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 145us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690348.631575:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3202 00010000:00010000:1.0:1779690348.632048:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913daf2 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7a0 expref: 22 pid: 57585 timeout: 3176 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690348.632080:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492292608:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690348.632101:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632110:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632116:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632128:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632134:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632141:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632146:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.632151:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632158:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632167:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.632170:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.632173:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632211:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dbee lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632223:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632229:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632234:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632239:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.632242:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632248:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632256:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.632258:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690348.632261:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.632266:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dbe0 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690348.632343:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503552896 00000100:00100000:2.0:1779690348.632349:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503552896 00000100:00100000:2.0:1779690348.632450:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6365 00000100:00100000:2.0:1779690348.632459:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+14:97622:x1866137503552896:12345-192.168.203.5@tcp:101:multiop.0 00010000:00010000:2.0:1779690348.632473:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690348.632491:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433821dd/0xb4bb873a1913dbf5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7f4 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690348.632522:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e6:0x0] initial LVB size: 1048576, mtime: 0x6a13eb67, atime: 0x6a13eb67, ctime: 0x6a13eb67, blocks: 0x803 00010000:00010000:2.0:1779690348.632539:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690348.632541:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690348.632548:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433821dd/0xb4bb873a1913dbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7f4 expref: 15 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.632562:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000433821dd/0xb4bb873a1913dbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7f4 expref: 15 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.632575:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad400, rc 0) 00000100:00100000:2.0:1779690348.632611:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+15:97622:x1866137503552896:12345-192.168.203.5@tcp:101:multiop.0 Request processed in 153us (1501us total) trans 0 rc 0/0 00000040:00080000:1.0:1779690348.632611:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690348.632617:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1779690348.632622:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6365 00000100:00080000:0.0:1779690348.633661:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1779690348.633888:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:1.0:1779690348.633901:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690348.634018:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+16:97625:x1866137503552512:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 23975us (24116us total) trans 12884902033 rc 0/0 00000100:00100000:1.0:1779690348.634030:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 273 00000020:00080000:1.0:1779690348.634035:0:57559:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1779690348.641262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.641471:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553280 00000100:00100000:1.0:1779690348.641481:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553280 00000100:00100000:1.0:1779690348.641541:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:1.0:1779690348.641550:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+20:97622:x1866137503553280:12345-192.168.203.5@tcp:35:multiop.0 00000001:00080000:1.0:1779690348.641797:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902034 00000001:00080000:1.0:1779690348.643598:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902035 00000100:00100000:1.0:1779690348.643745:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+23:97622:x1866137503553280:12345-192.168.203.5@tcp:35:multiop.0 Request processed in 2191us (2486us total) trans 12884902036 rc 0/0 00000100:00100000:1.0:1779690348.643756:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000020:00080000:1.0:1779690348.643762:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1779690348.643830:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.643913:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553536 00000100:00100000:0.0:1779690348.643921:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553536 00000100:00100000:0.0:1779690348.643971:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1779690348.643979:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+16:97625:x1866137503553536:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1779690348.644668:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1779690348.644778:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902037 00010000:00010000:0.0:1779690348.644866:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644884:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644896:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644904:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644911:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644916:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690348.644929:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1779690348.645008:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:97625:x1866137503553536:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1029us (1178us total) trans 12884902038 rc 0/0 00000100:00100000:0.0:1779690348.645017:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000020:00080000:0.0:1779690348.645021:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1779690348.645536:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690348.645544:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.645552:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690348.645555:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.645562:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.645575:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:2.0:1779690348.645578:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1779690348.645590:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.645597:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dbfc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.645615:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690348.645617:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690348.645618:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690348.660724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.661132:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553664 00000100:00100000:3.0:1779690348.661142:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553664 00002000:00100000:3.0:1779690348.661196:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1e6:0x0] (1048576->1048579) req@ffff9e3088324000 x1866137503553664/t0(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:584/0 lens 496/0 e 0 to 0 dl 1779690359 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690348.661218:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088324000 with x1866137503553664 ext(1048576->1048579) 00002000:00010000:3.0:1779690348.661224:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e3088324000 00000100:00100000:3.0:1779690348.661260:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2043 00000100:00100000:3.0:1779690348.661279:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503553664:12345-192.168.203.5@tcp:4:multiop.0 00000100:00100000:3.0:1779690348.662404:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503553664:12345-192.168.203.5@tcp:4:multiop.0 Request processed in 1129us (1681us total) trans 4294968336 rc 0/0 00000100:00100000:3.0:1779690348.662415:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2043 00002000:00100000:3.0:1779690348.662424:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1e6:0x0] (1048576->1048579) req@ffff9e3088324000 x1866137503553664/t4294968336(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:584/0 lens 496/448 e 0 to 0 dl 1779690359 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690348.662434:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088324000 with x1866137503553664 ext(1048576->1048579) 00002000:00010000:3.0:1779690348.662438:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e3088324000 00000100:00100000:0.0:1779690348.687800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.687895:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553792 00000100:00100000:1.0:1779690348.687902:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553792 00000100:00100000:1.0:1779690348.687961:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 274 00000100:00100000:1.0:1779690348.687973:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+23:97627:x1866137503553792:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:1.0:1779690348.687999:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690348.688019:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dc03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed7fb expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688081:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688095:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688121:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688136:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688149:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688155:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688492:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688499:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688504:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690348.688527:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048580 00000004:00200000:1.0:1779690348.688530:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690348.688546:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688553:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688559:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688574:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688580:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688585:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.688589:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688596:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688607:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:1.0:1779690348.688610:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.688615:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688621:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913dc0a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688633:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688639:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688644:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688649:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690348.688658:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688664:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688672:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x3800fa7 (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690348.688675:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690348.688678:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688684:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913dc11 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688711:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913dc03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7fb expref: 25 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688719:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9a00/0xb4bb873a1913dc18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7fb expref: 24 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690348.688724:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:1.0:1779690348.688725:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690348.688727:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9a00, rc 0) 00000100:00100000:1.0:1779690348.688788:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+24:97627:x1866137503553792:12345-192.168.203.5@tcp:101:stat.0 Request processed in 817us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.688794:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 274 00000100:00100000:2.0:1779690348.708890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.709027:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503553920 00000100:00100000:3.0:1779690348.709040:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503553920 00000100:00100000:3.0:1779690348.709107:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:3.0:1779690348.709136:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+22:97628:x1866137503553920:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:3.0:1779690348.709164:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690348.709188:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc1f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed802 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709266:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709292:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709306:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709323:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709330:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709336:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709741:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709751:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709758:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690348.709847:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xb:0x0]: returning size 1048580 00000004:00200000:3.0:1779690348.709852:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690348.709881:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709895:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709904:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709910:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709918:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709924:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690348.709929:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709937:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709949:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:3.0:1779690348.709952:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690348.709957:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709963:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc26 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709985:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709991:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.709997:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710002:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690348.710004:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710010:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710015:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x3800fa7 (ffff9e2f883cba00) 00010000:00010000:3.0:1779690348.710017:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690348.710020:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710025:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc2d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x3800fa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710058:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc1f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x71:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed802 expref: 24 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710070:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4200/0xb4bb873a1913dc34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed802 expref: 23 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690348.710087:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xb:0x0].0x0 (ffff9e308a642200) 00010000:00010000:3.0:1779690348.710089:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690348.710092:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4200, rc 0) 00000100:00100000:3.0:1779690348.710158:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+23:97628:x1866137503553920:12345-192.168.203.5@tcp:101:stat.0 Request processed in 1025us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.710166:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:3.0:1779690348.714425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690348.714534:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554048 00000100:00100000:0.0:1779690348.714548:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554048 00000100:00100000:0.0:1779690348.714662:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6366 00000100:00100000:0.0:1779690348.714690:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554048:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:0.0:1779690348.714713:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690348.714746:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000688378c3/0xb4bb873a1913dc3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed809 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690348.714873:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a342a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492292736:192.168.203.5@tcp:106: 00000100:00100000:0.0:1779690348.714998:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90821b40 going to sleep for 11 seconds 00000100:00080000:1.0:1779690348.715227:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1779690348.719001:0:6582:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb size: 1048576 -> 1048580 00002000:00010000:2.0:1779690348.719013:0:6582:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb mtime: 1779690343 -> 1779690348 00002000:00010000:2.0:1779690348.719017:0:6582:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb ctime: 1779690343 -> 1779690348 00000100:00100000:2.0:1779690348.719050:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a342a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492292736:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690348.719103:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000688378c3/0xb4bb873a1913dc3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed809 expref: 22 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.719133:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000688378c3/0xb4bb873a1913dc3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed809 expref: 22 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690348.719148:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d800, rc 0) 00000100:00100000:2.0:1779690348.719260:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554048:12345-192.168.203.5@tcp:101:stat.0 Request processed in 4571us (4849us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690348.719278:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6366 00000100:00100000:2.0:1779690348.993340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.993452:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554176 00000100:00100000:1.0:1779690348.993469:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554176 00000100:00100000:1.0:1779690348.993568:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:1.0:1779690348.993598:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+15:2392:x1866137503554176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690348.993633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.993698:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+15:2392:x1866137503554176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.993706:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:0.0:1779690348.993746:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554432 00000100:00100000:0.0:1779690348.993751:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554432 00000100:00100000:0.0:1779690348.993798:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2751 00000100:00100000:0.0:1779690348.993846:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690348.997707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.997769:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.997783:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554688 00000100:00100000:3.0:1779690348.997797:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.997797:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554688 00000100:00100000:3.0:1779690348.997846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.997872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.997886:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554304 00000100:00100000:1.0:1779690348.997890:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554304 00000100:00100000:3.0:1779690348.997913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690348.997921:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:1.0:1779690348.997935:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:2392:x1866137503554688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690348.997944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.997987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690348.998010:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554944 00000100:00100000:3.0:1779690348.998015:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554944 00000100:00100000:1.0:1779690348.998037:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:2392:x1866137503554688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.998047:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:1.0:1779690348.998137:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555072 00000100:00100000:1.0:1779690348.998155:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555072 00000100:00100000:1.0:1779690348.998174:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1779690348.998193:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+23:2392:x1866137503554304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690348.998225:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+23:2392:x1866137503554304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.998232:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1779690348.998244:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1779690348.998251:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:2392:x1866137503555072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690348.999033:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555200 00000100:00100000:3.0:1779690348.999049:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555200 00000100:00100000:3.0:1779690348.999644:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554560 00000100:00100000:3.0:1779690348.999649:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554560 00000100:00100000:3.0:1779690348.999695:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503554816 00000100:00100000:3.0:1779690348.999698:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503554816 00000100:00100000:3.0:1779690348.999717:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555328 00000100:00100000:3.0:1779690348.999719:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555328 00000100:00100000:3.0:1779690348.999743:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2752 00000100:00100000:3.0:1779690348.999753:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503554944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690348.999848:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503554944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690348.999857:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2752 00000100:00100000:1.0:1779690348.999916:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:2392:x1866137503555072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1663us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690348.999926:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00080000:1.0:1779690348.999963:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690348.999977:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2753 00000100:00100000:1.0:1779690348.999986:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503555200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690349.000017:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+6:2392:x1866137503555200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690349.000023:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2753 00000100:00100000:1.0:1779690349.000037:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2754 00000100:00100000:1.0:1779690349.000043:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690349.000069:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690349.000076:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2755 00000100:00100000:3.0:1779690349.000085:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503554816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690349.000112:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503554816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690349.000150:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2754 00000100:00100000:3.0:1779690349.000157:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2755 00000100:00100000:1.0:1779690349.000170:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2756 00000100:00100000:1.0:1779690349.000179:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+5:2392:x1866137503555328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690349.000207:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+5:2392:x1866137503555328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690349.000214:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2756 00000100:00100000:0.0:1779690349.002362:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503554432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 8539us (8711us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690349.002379:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2751 00010000:00010000:3.0:1779690349.005720:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690350.025970:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690351.050296:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690351.561045:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492292992:0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561129:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690351.561182:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492293504:0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561204:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690351.561252:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1779690351.561258:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492292864:0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561288:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690351.561310:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492293376:0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561335:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690351.561362:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492293120:0@lo:400:kworker.0 00000100:00100000:3.0:1779690351.561370:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492292992 00000100:00100000:3.0:1779690351.561377:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492292992 00000100:00100000:0.0:1779690351.561397:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690351.561410:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690351.561423:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293504 00000100:00100000:3.0:1779690351.561426:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293504 00000100:00100000:0.0:1779690351.561431:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690351.561436:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293120 00000100:00100000:3.0:1779690351.561438:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293120 00000100:00100000:0.0:1779690351.561446:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690351.561451:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492293248:0@lo:400:kworker.0 00000100:00100000:3.0:1779690351.561464:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1779690351.561468:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690351.561473:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561510:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293376 00000100:00100000:0.0:1779690351.561513:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293376 00000100:00100000:3.0:1779690351.561522:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492292992:12345-0@lo:400:kworker.0 Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690351.561529:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1779690351.561539:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293248 00000100:00100000:0.0:1779690351.561541:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293248 00000100:00100000:3.0:1779690351.561544:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1779690351.561549:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492293504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561558:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:0.0:1779690351.561563:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690351.561574:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492293504:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690351.561580:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1779690351.561587:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492293376:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690351.561591:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1779690351.561593:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1779690351.561603:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492293120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561603:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1779690351.561608:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492293248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.561770:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492293248:12345-0@lo:400:kworker.0 Request processed in 23us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690351.561778:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:1.0:1779690351.562070:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492292864 00000100:00100000:1.0:1779690351.562075:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492292864 00000100:00100000:1.0:1779690351.562117:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1779690351.562124:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.562159:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492292864:12345-0@lo:400:kworker.0 Request processed in 36us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690351.562165:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1779690351.562191:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690351.562195:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690351.562218:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690351.562328:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492292864:0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.562340:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968401 gen 2 00000004:00080000:1.0:1779690351.562345:0:3321:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968401 committed transno 4294968401 00000100:00100000:1.0:1779690351.562365:0:3321:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e2f95df1f80 x1866137492291712/t4294968402(4294968402) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1779690364 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1779690351.562375:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492293376:0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.562387:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492292992:0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.562395:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492293504:0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.562434:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293632 00000100:00100000:1.0:1779690351.562438:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293632 00000100:00100000:1.0:1779690351.562463:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1779690351.562469:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492293632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690351.562494:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 749666304 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:3.0:1779690351.565158:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492293120:12345-0@lo:400:kworker.0 Request processed in 3546us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690351.565171:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1779690351.565278:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690351.565339:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690351.565400:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492293760 00000100:00100000:3.0:1779690351.565408:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492293760 00000100:00100000:3.0:1779690351.565439:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1779690351.565458:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492293760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690351.565496:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 623575040 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690351.565536:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492293760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690351.565543:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1779690351.565585:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690351.565908:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492293248:0@lo:400:kworker.0 00000100:00100000:0.0:1779690351.565994:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492293120:0@lo:400:kworker.0 00000100:00100000:1.0:1779690351.567137:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492293632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4664us (5701us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690351.567148:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1779690351.569248:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492293632:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1779690351.690433:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690351.690441:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690351.690495:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 11 count 10 00000040:00080000:2.0:1779690351.690502:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690352.075119:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690352.449307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690352.455623:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555456 00000100:00100000:1.0:1779690352.455639:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555456 00000100:00100000:1.0:1779690352.455729:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 276 00000100:00100000:1.0:1779690352.455743:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:97460:x1866137503555456:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1779690352.455834:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690352.455873:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:97460:x1866137503555456:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 134us (6575us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690352.455882:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 276 00000100:00100000:2.0:1779690352.471970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690352.472062:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555712 00000100:00100000:3.0:1779690352.472071:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555712 00000100:00100000:3.0:1779690352.472119:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1779690352.472130:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90558450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+18:97460:x1866137503555712:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690352.472665:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90558450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+19:97460:x1866137503555712:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 535us (701us total) trans 12884902039 rc 0/0 00000100:00100000:3.0:1779690352.472673:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00010000:00010000:2.0:1779690353.097039:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690353.669548:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968402 is committed 00000001:00080000:2.0:1779690353.677992:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968334 is committed 00000001:00080000:2.0:1779690353.678011:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968336 is committed 00000001:00080000:2.0:1779690353.678020:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968335 is committed 00000001:00080000:3.0:1779690353.679141:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902038 is committed 00000001:00080000:3.0:1779690353.679156:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902036 is committed 00000020:00080000:3.0:1779690353.679280:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f90381300 refcount 2 committed 0 result 0 batchid 8590018963 00000020:00080000:3.0:1779690353.679286:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e30b45c7d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f903819c0 00000020:00080000:3.0:1779690353.679289:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e30b45c7400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e308d6a4000 00000001:00080000:3.0:1779690353.679325:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902039 is committed 00000020:00080000:2.0:1779690353.679328:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018963 committed batchid 8590018961 00000020:00080000:3.0:1779690353.679332:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018962 batchid updated 00000020:00080000:2.0:1779690353.679600:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018962 00000100:00100000:3.0:1779690353.764970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690353.765013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690353.765043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690353.765135:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555840 00000100:00100000:1.0:1779690353.765142:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503556096 00000100:00100000:2.0:1779690353.765145:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555840 00000100:00100000:1.0:1779690353.765160:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503556096 00000100:00100000:2.0:1779690353.765263:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503555968 00000100:00100000:2.0:1779690353.765268:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503555968 00000100:00100000:1.0:1779690353.766626:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18638 00000100:00100000:1.0:1779690353.766642:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+17:2389:x1866137503555840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690353.766660:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690353.766681:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e30bf4c5200/0xb4bb873a1913d955 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6ce expref: 17 pid: 57555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690353.766699:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690353.766753:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+16:2389:x1866137503555840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 118us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690353.766761:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18638 00000100:00100000:1.0:1779690353.766782:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18639 00000100:00100000:1.0:1779690353.766790:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+15:2389:x1866137503556096:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690353.766798:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690353.766832:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e30bf4c5600/0xb4bb873a1913d963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6ff expref: 15 pid: 57555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690353.766842:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690353.766860:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+14:2389:x1866137503556096:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 72us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690353.766866:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18639 00000100:00100000:1.0:1779690353.766881:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18640 00000100:00100000:1.0:1779690353.766888:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+13:2389:x1866137503555968:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690353.766895:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690353.766950:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e30bf4c5000/0xb4bb873a1913d95c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6f8 expref: 13 pid: 57555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690353.766974:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690353.766993:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503555968:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 106us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690353.767000:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18640 00000100:00100000:2.0:1779690353.780036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690353.780121:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503556224 00000100:00100000:1.0:1779690353.780131:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503556224 00000100:00100000:1.0:1779690353.780211:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6367 00000100:00100000:1.0:1779690353.780233:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+5:2388:x1866137503556224:12345-192.168.203.5@tcp:9:umount.0 00000020:00000080:1.0:1779690353.780261:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb4bb873a1913d978 00000100:00080000:1.0:1779690353.780270:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9e308602e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1779690353.780315:0:6581:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968402 00000100:00100000:1.0:1779690353.780720:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+2:2388:x1866137503556224:12345-192.168.203.5@tcp:9:umount.0 Request processed in 499us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690353.780728:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6367 00010000:00010000:3.0:1779690353.780849:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1779690353.781108:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690353.785525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690353.787464:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503556352 00000100:00100000:2.0:1779690353.787477:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503556352 00000100:00100000:2.0:1779690353.787623:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6368 00000100:00100000:2.0:1779690353.787635:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+5:2388:x1866137503556352:12345-192.168.203.5@tcp:9:umount.0 00000020:00000080:2.0:1779690353.787664:0:10273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb4bb873a1913d971 00000100:00080000:2.0:1779690353.787673:0:10273:0:(import.c:65:import_set_state_nolock()) ffff9e30bfc27000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1779690353.787712:0:10273:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968336 00000100:00100000:2.0:1779690353.787992:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+2:2388:x1866137503556352:12345-192.168.203.5@tcp:9:umount.0 Request processed in 360us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690353.788000:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6368 00010000:00010000:0.0:1779690353.788198:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1779690353.788890:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690353.801652:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690353.803608:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503556992 00000100:00100000:1.0:1779690353.803621:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503556992 00000100:00100000:1.0:1779690353.803697:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:1.0:1779690353.803708:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+9:2388:x1866137503556992:12345-192.168.203.5@tcp:39:umount.0 00000020:00000080:1.0:1779690353.803739:0:57559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb4bb873a1913d96a 00000020:00010000:1.0:1779690353.803756:0:57559:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e30bfc90800: total 0 00000100:00080000:1.0:1779690353.803760:0:57559:0:(import.c:65:import_set_state_nolock()) ffff9e30bfc94000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1779690353.803788:0:57559:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902039 00000100:00100000:1.0:1779690353.804152:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e142dd6-2774-4e7c-aac6-3ec8711f37a2+8:2388:x1866137503556992:12345-192.168.203.5@tcp:39:umount.0 Request processed in 445us (2511us total) trans 12884902040 rc 0/0 00000100:00100000:1.0:1779690353.804176:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 277 00000020:00010000:2.0:1779690353.805670:0:7463:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e30bfc90800: total 0 00010000:00010000:2.0:1779690353.805723:0:7463:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e30bfc90800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1779690353.805842:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:2.0:1779690353.805846:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690353.805856:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913d986 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed729 expref: 7 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690353.805875:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690353.805877:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690353.805881:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913d9be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed737 expref: 6 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690353.805909:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x71:0x0].0x0 (ffff9e308bf54500) 00010000:00010000:2.0:1779690353.805911:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690353.805915:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913db46 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x71:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7b5 expref: 5 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690353.805929:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:2.0:1779690353.805931:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690353.805934:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5a00/0xb4bb873a1913d9a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed730 expref: 4 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690353.805945:0:7463:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e30bfc90800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1779690353.805958:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690353.805960:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690353.805962:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690354.116575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116619:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116657:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116686:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690354.116764:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690354.116912:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557120 00000100:00100000:1.0:1779690354.116921:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557120 00000100:00100000:1.0:1779690354.116975:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1779690354.116985:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503557120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117052:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503557120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117059:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1779690354.117091:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557632 00000100:00100000:1.0:1779690354.117095:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557632 00000100:00100000:1.0:1779690354.117124:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557248 00000100:00100000:1.0:1779690354.117127:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557248 00000100:00100000:1.0:1779690354.117146:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1779690354.117153:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:2390:x1866137503557632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117182:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:2390:x1866137503557632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117188:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1779690354.117201:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:1.0:1779690354.117208:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+23:2390:x1866137503557248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117244:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+23:2390:x1866137503557248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117250:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:1.0:1779690354.117269:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557376 00000100:00100000:1.0:1779690354.117272:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557376 00000100:00100000:1.0:1779690354.117296:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557888 00000100:00100000:1.0:1779690354.117305:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557888 00000100:00100000:1.0:1779690354.117325:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557504 00000100:00100000:1.0:1779690354.117328:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557504 00000100:00100000:1.0:1779690354.117345:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503557760 00000100:00100000:1.0:1779690354.117348:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503557760 00000100:00100000:1.0:1779690354.117368:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2759 00000100:00100000:1.0:1779690354.117374:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503557376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117400:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503557376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117406:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2759 00000100:00100000:1.0:1779690354.117418:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2760 00000100:00100000:1.0:1779690354.117424:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503557888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117449:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503557888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117455:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2760 00000100:00100000:1.0:1779690354.117466:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2761 00000100:00100000:1.0:1779690354.117472:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503557504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117493:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503557504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117499:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2761 00000100:00100000:1.0:1779690354.117515:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2762 00000100:00100000:1.0:1779690354.117522:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503557760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690354.117544:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503557760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690354.117549:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2762 00000100:00080000:1.0:1779690354.117581:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690354.117586:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690354.117588:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690354.121116:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690355.130632:0:61742:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 02:25:53 (1779690353) 00010000:00010000:0.0:1779690355.146939:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690355.244073:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690355.245266:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558016 00000100:00100000:1.0:1779690355.245277:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558016 00000100:00100000:1.0:1779690355.245341:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:1.0:1779690355.245350:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:98222:x1866137503558016:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690355.245368:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690355.245386:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913dc42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed810 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245444:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245458:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245467:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245479:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245485:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245490:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245731:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245748:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245755:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245760:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690355.245764:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245772:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245784:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:1.0:1779690355.245787:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690355.245792:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245798:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913dc49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245901:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245907:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245913:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245918:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690355.245926:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245932:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245940:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2046ad56 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690355.245942:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690355.245945:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.245951:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913dc50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.246060:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913dc42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed810 expref: 22 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.246072:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:1.0:1779690355.246074:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690355.246078:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913dc42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed810 expref: 22 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.246089:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9c00, rc 0) 00000100:00100000:1.0:1779690355.247260:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+21:98222:x1866137503558016:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1904us (3191us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690355.247270:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:3.0:1779690355.257127:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690355.257322:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558272 00000100:00100000:0.0:1779690355.257332:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558272 00000100:00100000:0.0:1779690355.257378:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 279 00000100:00100000:0.0:1779690355.257388:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+21:98222:x1866137503558272:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690355.257438:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690355.257464:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913d9d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed73e expref: 21 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.257482:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:0.0:1779690355.257487:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690355.257743:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.257758:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 22 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.257767:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.257801:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 22 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.257838:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 22 pid: 57559 timeout: 3182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690355.257853:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492293888:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690355.257941:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3091c03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690355.261235:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492293888:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690355.261271:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690355.261424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690355.261490:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558400 00000100:00100000:0.0:1779690355.261497:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558400 00010000:00010000:0.0:1779690355.261528:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 23 pid: 57559 timeout: 3182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690355.261562:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3203 00000100:00100000:0.0:1779690355.261571:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+23:2392:x1866137503558400:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690355.261583:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690355.261589:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 23 pid: 57559 timeout: 3182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261601:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 23 pid: 57559 timeout: 3182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261622:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a1913d8d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed6a4 expref: 23 pid: 57559 timeout: 3182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261636:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:0.0:1779690355.261641:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261650:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261657:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.261686:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690355.261731:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+22:2392:x1866137503558400:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 161us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690355.261739:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3203 00010000:00010000:3.0:1779690355.261924:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.261932:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.261953:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.262002:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.262011:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690355.264454:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00010000:00010000:3.0:1779690355.264470:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264481:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264488:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264494:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.264498:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264506:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264520:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54d00) 00010000:00010000:3.0:1779690355.264523:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.264527:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.264533:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913dc57 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690355.264552:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d89770f reply state 000000001fc0f419 transno 12884902041 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690355.264561:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1779690355.264769:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+22:98222:x1866137503558272:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 7379us (7658us total) trans 12884902041 rc 0/0 00000100:00100000:3.0:1779690355.264788:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 279 00010000:00010000:3.0:1779690355.276898:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.276915:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.276922:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.276928:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.276932:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.276940:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.276957:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2046ad56 (ffff9e2f883cbc00) 00010000:00010000:3.0:1779690355.276960:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.276964:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.277065:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc5e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690355.314630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690355.314995:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558528 00000100:00100000:2.0:1779690355.315004:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558528 00000100:00100000:2.0:1779690355.315057:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 280 00000100:00100000:2.0:1779690355.315067:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+22:98232:x1866137503558528:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690355.315088:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690355.315111:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dc65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed817 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315177:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315192:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315213:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690355.315274:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690355.315279:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 96 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690355.315302:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315325:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dc65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed817 expref: 24 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315339:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed817 expref: 23 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.315363:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642400) 00010000:00010000:2.0:1779690355.315366:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690355.315369:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:2.0:1779690355.315430:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+23:98232:x1866137503558528:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 364us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690355.315438:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 280 00000100:00100000:1.0:1779690355.332252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690355.332340:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558784 00000100:00100000:0.0:1779690355.332349:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558784 00000100:00100000:0.0:1779690355.332408:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:0.0:1779690355.332418:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+23:98232:x1866137503558784:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:0.0:1779690355.332470:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690355.332497:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913dc6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed817 expref: 23 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.332514:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642400) 00010000:00010000:0.0:1779690355.332525:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690355.332681:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+22:98232:x1866137503558784:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 264us (436us total) trans 0 rc -17/-17 00000100:00100000:0.0:1779690355.332689:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:0.0:1779690355.336881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690355.336912:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503558912 00000100:00100000:0.0:1779690355.336921:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503558912 00000100:00100000:0.0:1779690355.336967:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00100000:0.0:1779690355.336976:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+22:98232:x1866137503558912:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690355.337002:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690355.337024:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913dc73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed81e expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337100:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337113:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337124:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690355.337177:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:0.0:1779690355.337181:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 96 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690355.337213:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337235:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913dc73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 24 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337251:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 23 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.337259:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:0.0:1779690355.337262:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690355.337266:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:0.0:1779690355.337375:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+23:98232:x1866137503558912:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 399us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690355.337382:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00100000:1.0:1779690355.340466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.341094:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559040 00000100:00100000:3.0:1779690355.341104:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559040 00000100:00100000:3.0:1779690355.341160:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00100000:3.0:1779690355.341170:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+23:98232:x1866137503559040:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1779690355.341188:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690355.341229:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed825 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341299:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341313:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341323:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341335:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341342:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341348:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341438:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341446:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341454:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690355.341490:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00000004:00200000:3.0:1779690355.341494:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690355.341515:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341533:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341540:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341546:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341552:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.341556:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341564:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341575:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:3.0:1779690355.341578:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.341583:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341589:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dc88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341601:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341608:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341614:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341624:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.341628:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341634:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341642:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2046ad56 (ffff9e2f883cbc00) 00010000:00010000:3.0:1779690355.341645:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.341648:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341654:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dc8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341684:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dc81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed825 expref: 25 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341697:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed825 expref: 24 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.341704:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:3.0:1779690355.341706:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690355.341709:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4a00, rc 0) 00000100:00100000:3.0:1779690355.342252:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+24:98232:x1866137503559040:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1081us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690355.342261:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00100000:1.0:1779690355.364929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690355.365025:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559168 00000100:00100000:2.0:1779690355.365035:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559168 00000100:00100000:2.0:1779690355.365090:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 284 00000100:00100000:2.0:1779690355.365099:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+24:98233:x1866137503559168:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690355.365125:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690355.365144:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dc9d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed82c expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365372:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365387:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365398:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365409:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365413:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365436:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365507:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365514:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365530:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365536:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690355.365539:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365546:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365556:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:2.0:1779690355.365559:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690355.365563:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365568:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365579:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365584:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365596:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365601:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690355.365604:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365610:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365617:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x501f2203 (ffff9e308a642500) 00010000:00010000:2.0:1779690355.365619:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690355.365622:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365628:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365794:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dc9d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed82c expref: 25 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365917:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:2.0:1779690355.365921:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690355.365926:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dc9d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed82c expref: 25 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.365937:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad000, rc 0) 00000100:00100000:2.0:1779690355.365993:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+24:98233:x1866137503559168:12345-192.168.203.5@tcp:101:rm.0 Request processed in 895us (1072us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690355.366011:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 284 00000100:00100000:0.0:1779690355.378694:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.378748:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559424 00000100:00100000:3.0:1779690355.378770:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559424 00000100:00100000:3.0:1779690355.378899:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 285 00000100:00100000:3.0:1779690355.378909:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+24:98234:x1866137503559424:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1779690355.378928:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690355.378931:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690355.378957:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dc96 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed825 expref: 24 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.378975:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:3.0:1779690355.378985:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690355.378999:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcb2 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed833 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379143:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379157:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379166:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379177:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379183:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.379189:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690355.379851:0:57585:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e6:0x0], index 1: 0 00010000:00010000:3.0:1779690355.380007:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5a00/0xb4bb873a1913dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380017:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5a00/0xb4bb873a1913dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380024:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5a00/0xb4bb873a1913dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380060:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380067:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380073:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380079:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.380083:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380090:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380100:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:3.0:1779690355.380102:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.380106:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380122:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dcb9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690355.380134:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a5681961 reply state 0000000072ebf759 transno 12884902042 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690355.380142:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690355.380169:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed833 expref: 26 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380186:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5a00/0xb4bb873a1913dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed833 expref: 25 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.380193:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:3.0:1779690355.380195:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690355.380198:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5a00, rc 0) 00000100:00100000:3.0:1779690355.380274:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+26:98234:x1866137503559424:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1366us (1587us total) trans 12884902042 rc 0/0 00000100:00100000:3.0:1779690355.380282:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 285 00010000:00010000:3.0:1779690355.383078:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383093:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383101:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383107:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.383123:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383130:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383145:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x501f2203 (ffff9e2f883cb900) 00010000:00010000:3.0:1779690355.383148:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.383152:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.383158:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690355.384044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.384196:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559680 00000100:00100000:3.0:1779690355.384440:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559680 00000100:00100000:3.0:1779690355.384499:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:3.0:1779690355.384508:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+25:98234:x1866137503559680:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:3.0:1779690355.385023:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+26:98234:x1866137503559680:12345-192.168.203.5@tcp:35:dd.0 Request processed in 514us (984us total) trans 12884902043 rc 0/0 00000100:00100000:3.0:1779690355.385032:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:0.0:1779690355.402477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690355.402711:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559808 00000100:00100000:2.0:1779690355.402721:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559808 00000100:00100000:2.0:1779690355.402847:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 286 00000100:00100000:2.0:1779690355.402857:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+26:98235:x1866137503559808:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690355.402881:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690355.402900:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dcd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed83a expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.402959:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.402972:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.402983:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.402997:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403004:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403010:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403136:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dcea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403157:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dcea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403164:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dcea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690355.403198:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00000004:00200000:2.0:1779690355.403213:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690355.403236:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dcea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403248:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403254:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403261:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403267:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690355.403270:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403276:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403287:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:2.0:1779690355.403290:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690355.403295:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403311:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dcdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403325:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403330:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403336:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403341:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690355.403344:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403351:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403358:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2046ad56 (ffff9e308a642500) 00010000:00010000:2.0:1779690355.403361:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690355.403364:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403369:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403398:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dcd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed83a expref: 28 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403424:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac400/0xb4bb873a1913dcea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed83a expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.403432:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:2.0:1779690355.403435:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690355.403437:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ac400, rc 0) 00000100:00100000:2.0:1779690355.403497:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98235:x1866137503559808:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 642us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690355.403504:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 286 00000100:00100000:1.0:1779690355.452228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.452359:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503559936 00000100:00100000:3.0:1779690355.452368:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503559936 00000100:00100000:3.0:1779690355.452429:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:3.0:1779690355.452440:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:98240:x1866137503559936:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1779690355.452461:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690355.452481:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed841 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452559:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452573:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452587:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690355.452644:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00000004:00200000:3.0:1779690355.452649:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690355.452671:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452695:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dcf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed841 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452712:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed841 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.452721:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690355.452724:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690355.452727:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5800, rc 0) 00000100:00100000:3.0:1779690355.452789:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+28:98240:x1866137503559936:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 352us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690355.452796:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:3.0:1779690355.462159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690355.462397:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503560064 00000100:00100000:0.0:1779690355.462408:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503560064 00000100:00100000:0.0:1779690355.462473:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00100000:0.0:1779690355.462485:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98241:x1866137503560064:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690355.462505:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690355.462524:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913dcff lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed848 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462592:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462608:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462619:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462632:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462638:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462645:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462720:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462727:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462746:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462752:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690355.462756:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462763:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462774:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:0.0:1779690355.462777:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690355.462781:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462787:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913dd06 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462853:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462861:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462866:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462871:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690355.462874:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462898:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462907:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x855e6f0c (ffff9e308bf54200) 00010000:00010000:0.0:1779690355.462910:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690355.462913:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462918:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913dd0d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462954:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913dcff lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed848 expref: 29 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.462962:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:0.0:1779690355.463581:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690355.463588:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913dcff lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed848 expref: 29 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690355.463602:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690355.463671:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98241:x1866137503560064:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1187us (1519us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690355.463679:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00100000:1.0:1779690355.474986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.475066:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503560320 00000100:00100000:3.0:1779690355.475090:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503560320 00000100:00100000:3.0:1779690355.475151:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:3.0:1779690355.475161:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+28:98242:x1866137503560320:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1779690355.475182:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690355.475184:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690355.475219:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dcf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed841 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475239:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690355.475243:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690355.475257:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd14 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed84f expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475384:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475397:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475407:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475420:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475426:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.475431:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690355.476192:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e7:0x0], index 0: 0 00010000:00010000:3.0:1779690355.476364:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476375:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476383:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476412:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476419:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476426:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476431:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.476436:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476442:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476451:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690355.476454:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.476458:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476473:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd1b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690355.476484:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e1a4a727 reply state 00000000f697e6ec transno 12884902044 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690355.476492:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690355.476521:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd14 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 30 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476533:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.476540:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:3.0:1779690355.476542:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690355.476545:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5c00, rc 0) 00000100:00100000:3.0:1779690355.476728:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+30:98242:x1866137503560320:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1560us (1742us total) trans 12884902044 rc 0/0 00000100:00100000:3.0:1779690355.476737:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:1.0:1779690355.483539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690355.483626:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503560576 00000100:00100000:2.0:1779690355.483636:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503560576 00000100:00100000:0.0:1779690355.484172:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:0.0:1779690355.484187:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+30:98242:x1866137503560576:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690355.484980:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+31:98242:x1866137503560576:12345-192.168.203.5@tcp:35:dd.0 Request processed in 795us (1446us total) trans 12884902045 rc 0/0 00000100:00100000:0.0:1779690355.485005:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00010000:00010000:1.0:1779690355.485276:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.485288:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.485295:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.485302:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690355.486183:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.486194:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.486219:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x855e6f0c (ffff9e2f883cb900) 00010000:00010000:1.0:1779690355.486222:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690355.486227:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690355.486233:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd22 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690355.695382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690355.695538:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503560832 00000100:00100000:2.0:1779690355.695548:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503560832 00000100:00100000:2.0:1779690355.695607:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 290 00000100:00100000:2.0:1779690355.695618:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+30:98269:x1866137503560832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690355.695641:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690355.695672:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dd37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed856 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.695741:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.695756:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.695766:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.695795:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.696011:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690355.696021:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696508:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696520:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696528:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690355.696538:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1779690355.696698:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696706:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696711:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696716:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.696720:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696726:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696737:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:3.0:1779690355.696740:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.696745:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696750:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913dd3e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696761:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696767:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696772:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696787:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ada00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690355.696790:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.696796:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.697243:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e308a642500) 00010000:00010000:3.0:1779690355.697247:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.697251:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.697257:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913dd45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.697976:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dd37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed856 expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.697997:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed856 expref: 32 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.698005:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690355.698007:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690355.698010:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:3.0:1779690355.698081:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+32:98269:x1866137503560832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2465us (2708us total) trans 12884902046 rc 0/0 00000100:00100000:3.0:1779690355.698089:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 290 00000100:00100000:2.0:1779690355.706458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.706537:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503560960 00000100:00100000:3.0:1779690355.706558:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503560960 00000100:00100000:3.0:1779690355.706628:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18641 00000100:00100000:3.0:1779690355.706639:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+32:2389:x1866137503560960:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690355.706660:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690355.706684:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed856 expref: 32 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690355.706714:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690355.706718:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690355.706778:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+31:2389:x1866137503560960:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690355.706785:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18641 00000100:00100000:2.0:1779690355.709312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690355.709386:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561088 00000100:00100000:3.0:1779690355.709395:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561088 00000100:00100000:3.0:1779690355.709460:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 291 00000100:00100000:3.0:1779690355.709470:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+31:98269:x1866137503561088:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1779690355.709589:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+31:98269:x1866137503561088:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 121us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690355.709607:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 291 00000040:00080000:2.0:1779690355.785116:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690355.785126:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690355.785643:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:2.0:1779690355.785663:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690356.170340:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690356.682036:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690356.682503:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690356.682535:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492294400:0@lo:400:kworker.0 00000100:00100000:2.0:1779690356.682588:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492294272:0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.682634:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690356.682654:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690356.682698:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690356.682713:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294144 00000100:00100000:3.0:1779690356.682721:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690356.682723:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294144 00000100:00100000:3.0:1779690356.682741:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294656:0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.682764:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690356.682781:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294016 00000100:00100000:1.0:1779690356.682785:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294016 00000100:00100000:3.0:1779690356.682793:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690356.682799:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492294528:0@lo:400:kworker.0 00000100:00100000:1.0:1779690356.682831:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1779690356.682848:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492294144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690356.682853:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690356.682881:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294656 00000100:00100000:3.0:1779690356.682885:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294656 00000100:00100000:3.0:1779690356.682915:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1779690356.682921:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492294656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.682968:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492294656:12345-0@lo:400:kworker.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690356.682975:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1779690356.683004:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294400 00000100:00100000:3.0:1779690356.683007:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294400 00000100:00100000:0.0:1779690356.683022:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492294912:0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.683033:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1779690356.683039:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492294400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.683072:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492294400:12345-0@lo:400:kworker.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690356.683079:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1779690356.683091:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294528 00000100:00100000:3.0:1779690356.683093:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294528 00000100:00100000:3.0:1779690356.683115:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1779690356.683120:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492294528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.683146:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492294528:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690356.683152:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1779690356.683179:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690356.683207:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492294528:0@lo:400:kworker.0 00000100:00100000:3.0:1779690356.683217:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968335 gen 2 00000100:00100000:0.0:1779690356.683217:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492294400:0@lo:400:kworker.0 00000004:00080000:3.0:1779690356.683222:0:3321:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968335 committed transno 4294968335 00000100:00100000:3.0:1779690356.683254:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294656:0@lo:400:kworker.0 00000100:00100000:0.0:1779690356.683402:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294912 00000100:00100000:0.0:1779690356.683406:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294912 00000100:00100000:0.0:1779690356.683434:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1779690356.683441:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492294912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690356.683477:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492294912:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690356.683483:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1779690356.683512:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492294912:0@lo:400:kworker.0 00000100:00100000:0.0:1779690356.683553:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1779690356.683560:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690356.683590:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690356.683630:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690356.683636:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:0.0:1779690356.683656:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690356.683661:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690356.683663:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690356.683679:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968402 gen 2 00000004:00080000:0.0:1779690356.683690:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f95df1f80, transno 4294968402 00000100:00100000:0.0:1779690356.683710:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294016:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690356.683837:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690356.683892:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492294144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1047us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690356.683899:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1779690356.684730:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690356.684795:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492294784:0@lo:400:kworker.0 00000100:00100000:2.0:1779690356.684851:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690356.685124:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294784 00000100:00100000:3.0:1779690356.685133:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294784 00000100:00100000:3.0:1779690356.685199:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:3.0:1779690356.685211:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492294784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690356.685265:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492294144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690356.685293:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492294784:12345-0@lo:400:kworker.0 Request processed in 84us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690356.685302:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1779690356.685373:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492294784:0@lo:400:kworker.0 00000100:00100000:1.0:1779690356.685720:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492294272 00000100:00100000:1.0:1779690356.685727:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492294272 00000100:00100000:1.0:1779690356.685771:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1779690356.685778:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492294272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690356.685847:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492294272:12345-0@lo:400:kworker.0 Request processed in 69us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690356.685852:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1779690356.686328:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492294272:0@lo:400:kworker.0 00000100:00100000:1.0:1779690357.163950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690357.164047:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561216 00000100:00100000:2.0:1779690357.164058:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561216 00000100:00080000:1.0:1779690357.164119:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690357.164132:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 292 00000100:00100000:2.0:1779690357.164143:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+21:98289:x1866137503561216:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690357.164194:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690357.164215:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dd5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed85d expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164276:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164290:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164303:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690357.164361:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690357.164365:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 96 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690357.164389:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164414:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dd5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed85d expref: 23 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164432:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed85d expref: 22 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.164442:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:2.0:1779690357.164445:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690357.164449:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:2.0:1779690357.164512:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+22:98289:x1866137503561216:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 371us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690357.164519:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 292 00000100:00100000:2.0:1779690357.169748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.169927:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561344 00000100:00100000:3.0:1779690357.169937:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561344 00000100:00100000:3.0:1779690357.170033:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:3.0:1779690357.170044:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+22:98289:x1866137503561344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690357.170062:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690357.170080:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed864 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170143:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170158:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170169:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170191:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170199:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170214:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170323:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5000/0xb4bb873a1913dd7d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170332:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5000/0xb4bb873a1913dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170339:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5000/0xb4bb873a1913dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690357.170370:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00000004:00200000:3.0:1779690357.170374:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690357.170397:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5000/0xb4bb873a1913dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170408:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170414:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170421:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170426:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690357.170430:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170437:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170455:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:3.0:1779690357.170458:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690357.170463:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170469:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913dd6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170634:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170640:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170645:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170649:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690357.170652:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170658:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170666:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2046ad56 (ffff9e2f883cb100) 00010000:00010000:3.0:1779690357.170669:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690357.170672:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170676:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913dd76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2046ad56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170714:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dd68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed864 expref: 24 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170726:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5000/0xb4bb873a1913dd7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed864 expref: 23 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.170734:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690357.170737:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690357.170739:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5000, rc 0) 00000100:00100000:3.0:1779690357.170860:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+23:98289:x1866137503561344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 817us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690357.170867:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:1.0:1779690357.177295:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.177376:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561472 00000100:00100000:3.0:1779690357.177386:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561472 00000100:00100000:3.0:1779690357.177447:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 294 00000100:00100000:3.0:1779690357.177458:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+23:98289:x1866137503561472:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690357.177480:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690357.177498:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dd84 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed86b expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.177744:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.177760:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.177771:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.177793:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.177801:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.178435:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.178537:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180058:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180070:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690357.180112:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xd:0x0]: returning size 0 00000004:00200000:3.0:1779690357.180117:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690357.180137:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180147:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180155:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180162:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180180:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180340:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690357.180345:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180354:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180368:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690357.180371:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690357.180376:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180383:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dd8b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180398:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180405:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180411:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180417:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690357.180420:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180437:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180447:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x501f2203 (ffff9e2f883cbd00) 00010000:00010000:3.0:1779690357.180450:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690357.180454:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180459:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913dd92 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x501f2203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180506:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dd84 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed86b expref: 25 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180519:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86c00/0xb4bb873a1913dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed86b expref: 24 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.180526:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:3.0:1779690357.180529:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690357.180531:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86c00, rc 0) 00000100:00100000:3.0:1779690357.180607:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+24:98289:x1866137503561472:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3150us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690357.180617:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 294 00000100:00100000:0.0:1779690357.188454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690357.188533:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561600 00000100:00100000:2.0:1779690357.188543:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561600 00000100:00100000:2.0:1779690357.188621:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6369 00000100:00100000:2.0:1779690357.188631:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503561600:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690357.188661:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690357.188681:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2db83d8/0xb4bb873a1913dda0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed872 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690357.188710:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1779690357.188729:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690357.188731:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690357.188739:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2db83d8/0xb4bb873a1913dda0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed872 expref: 13 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.188757:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2db83d8/0xb4bb873a1913dda0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed872 expref: 13 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690357.188770:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ac200, rc 0) 00000100:00100000:2.0:1779690357.188842:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+13:2392:x1866137503561600:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690357.188848:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6369 00000100:00080000:0.0:1779690357.189122:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690357.194026:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690357.194377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690357.194442:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561728 00000100:00100000:0.0:1779690357.194454:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561728 00000100:00100000:0.0:1779690357.194509:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00100000:0.0:1779690357.194519:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+24:98289:x1866137503561728:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690357.194538:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690357.194557:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913dda7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed879 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194619:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194642:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194653:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194669:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194677:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194683:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194788:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194797:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194872:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690357.194906:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xe:0x0]: returning size 0 00000004:00200000:0.0:1779690357.194910:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690357.194928:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194939:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194948:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194954:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194961:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194966:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690357.194970:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194977:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.194996:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:0.0:1779690357.194998:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690357.195003:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195009:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913ddae lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195020:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195026:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195032:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195036:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690357.195039:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195044:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195051:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x855e6f0c (ffff9e308bf54a00) 00010000:00010000:0.0:1779690357.195053:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690357.195055:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195061:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913ddb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x855e6f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195098:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913dda7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 26 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195110:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 25 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690357.195117:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:0.0:1779690357.195119:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690357.195122:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483de00, rc 0) 00000100:00100000:0.0:1779690357.195176:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+25:98289:x1866137503561728:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 658us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690357.195195:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00100000:0.0:1779690357.201709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.201783:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561856 00000100:00100000:3.0:1779690357.201792:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561856 00000100:00100000:3.0:1779690357.201880:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6370 00000100:00100000:3.0:1779690357.201891:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503561856:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690357.201918:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690357.201939:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f385b9/0xb4bb873a1913ddc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed880 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690357.201966:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690357.201985:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690357.201987:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690357.201995:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f385b9/0xb4bb873a1913ddc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed880 expref: 16 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.202013:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062f385b9/0xb4bb873a1913ddc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed880 expref: 16 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.202026:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86200, rc 0) 00000100:00100000:3.0:1779690357.202078:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+16:2391:x1866137503561856:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 189us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690357.202085:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6370 00000100:00080000:0.0:1779690357.202259:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690357.206152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.206218:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503561984 00000100:00100000:3.0:1779690357.206227:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503561984 00000100:00100000:3.0:1779690357.206278:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 296 00000100:00100000:3.0:1779690357.206287:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+25:98289:x1866137503561984:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690357.206306:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690357.206325:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed887 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206389:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87800/0xb4bb873a1913ddd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206413:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87800/0xb4bb873a1913ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206424:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87800/0xb4bb873a1913ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690357.206484:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x73:0x0]: returning size 512 00000004:00200000:3.0:1779690357.206488:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690357.206509:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87800/0xb4bb873a1913ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206536:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed887 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206551:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87800/0xb4bb873a1913ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x73:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed887 expref: 26 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.206560:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x73:0x0].0x0 (ffff9e308a642400) 00010000:00010000:3.0:1779690357.206563:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690357.206567:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87800, rc 0) 00000100:00100000:3.0:1779690357.206625:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+26:98289:x1866137503561984:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 339us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690357.206632:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 296 00000100:00100000:3.0:1779690357.219288:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.219323:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503562240 00000100:00100000:3.0:1779690357.219331:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503562240 00000100:00100000:3.0:1779690357.219374:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 297 00000100:00100000:3.0:1779690357.219385:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+26:98289:x1866137503562240:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690357.219863:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].11, 136 off9688 00000040:00080000:3.0:1779690357.220014:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].12, 136 off9824 00000100:00100000:3.0:1779690357.220087:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+26:98289:x1866137503562240:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 703us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690357.220096:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 297 00000040:00080000:3.0:1779690357.937799:0:61888:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690357.937837:0:61888:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690357.937926:0:61888:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 13 count 12 00000040:00080000:3.0:1779690357.937934:0:61888:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690357.989504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690357.989573:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503562496 00000100:00100000:3.0:1779690357.989583:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503562496 00000100:00100000:3.0:1779690357.989655:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 298 00000100:00100000:3.0:1779690357.989666:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+26:98299:x1866137503562496:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690357.989687:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690357.989706:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed88e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.989801:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.989846:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.989859:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690357.989867:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xe:0x0]: returning size 0 00010000:00010000:3.0:1779690357.989975:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x73:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 29 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.990004:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690357.990013:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:3.0:1779690357.990015:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690357.990019:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86e00, rc 0) 00000100:00100000:3.0:1779690357.990073:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+28:98299:x1866137503562496:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 409us (579us total) trans 12884902047 rc 0/0 00000100:00100000:3.0:1779690357.990081:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 298 00000100:00100000:2.0:1779690357.993705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690357.993744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690357.993750:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503562752 00000100:00100000:1.0:1779690357.993758:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503562752 00000100:00100000:1.0:1779690357.993966:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 299 00000100:00100000:1.0:1779690357.993977:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:98299:x1866137503562752:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:1.0:1779690357.994057:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994075:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 30 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994085:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994120:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994128:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 6/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994163:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994189:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690357.994203:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295040:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690357.994307:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994317:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690357.994327:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295168:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690357.994366:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 30 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.994376:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 30 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690357.994405:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295296:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690357.994432:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089bba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690357.995029:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503562880 00000100:00100000:1.0:1779690357.995034:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503562880 00010000:00010000:1.0:1779690357.995055:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 29 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690357.995084:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3204 00000100:00100000:1.0:1779690357.995092:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:2389:x1866137503562880:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690357.995102:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690357.995108:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 29 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.995120:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 29 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.995143:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:1.0:1779690357.995148:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.995156:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690357.995162:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690357.995219:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:2389:x1866137503562880:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 126us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690357.995240:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3204 00000100:00100000:0.0:1779690358.003553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.003647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.003680:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563136 00000100:00100000:0.0:1779690358.003688:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563136 00010000:00010000:0.0:1779690358.003736:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 31 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.003820:0:57561:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.5@tcp) returned -22 from blocking AST (req@0000000092f3ea6e x1866137492295040) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 1/0,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.003843:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913dddf lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed88e expref: 28 pid: 57559 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690358.003857:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295040:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690358.003878:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295168:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690358.003889:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492295296:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690358.003915:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563008 00010000:00010000:1.0:1779690358.003924:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00000100:00100000:2.0:1779690358.003927:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563008 00010000:00010000:1.0:1779690358.003930:0:57561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.003941:0:57561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.003947:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.003952:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690358.003990:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3205 00000100:00100000:2.0:1779690358.003999:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:2391:x1866137503563008:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690358.004012:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690358.004017:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.004028:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.004048:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913ddbc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed879 expref: 28 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.004059:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:2.0:1779690358.004063:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.004069:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.004075:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690358.004130:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:2391:x1866137503563008:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 132us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690358.004138:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3205 00000100:00100000:0.0:1779690358.004220:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3206 00000100:00100000:0.0:1779690358.004229:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+31:2392:x1866137503563136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690358.004237:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690358.004242:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 31 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004258:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 31 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004271:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913dd29 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed84f expref: 31 pid: 57561 timeout: 3185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004340:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:0.0:1779690358.004345:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004353:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004362:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.004379:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690358.004398:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+30:2392:x1866137503563136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 171us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690358.004405:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3206 00000100:00080000:0.0:1779690358.004423:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690358.004708:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004716:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004947:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004963:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004970:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004976:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690358.004980:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004988:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.004999:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xe:0x0].0x0 (ffff9e2f883cbc00) 00010000:00010000:1.0:1779690358.005002:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690358.005006:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.005012:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913dded lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xe:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690358.005091:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:98299:x1866137503562752:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 11115us (11388us total) trans 12884902048 rc 0/0 00000100:00100000:1.0:1779690358.005100:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 299 00000100:00100000:0.0:1779690358.007040:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690358.007150:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563392 00000100:00100000:1.0:1779690358.007159:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563392 00000100:00100000:1.0:1779690358.007219:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:1.0:1779690358.007229:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+27:98299:x1866137503563392:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1779690358.007503:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+28:98299:x1866137503563392:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 275us (468us total) trans 12884902049 rc 0/0 00000100:00100000:1.0:1779690358.007518:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00010000:00010000:0.0:1779690358.217088:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1779690358.784162:0:6605:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00000080:0.0:1779690358.784200:0:6605:0:(genops.c:906:class_export_put()) final put ffff9e30bfc26800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00000080:0.0:1779690358.784364:0:47576:0:(genops.c:865:class_export_destroy()) destroying export ffff9e30bfc26800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 for lustre-OST0000 00000020:00000080:0.0:1779690358.784427:0:47576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e30bfc27000 for lustre-OST0000 00000001:00080000:1.0:1779690358.807865:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902045 is committed 00000001:00080000:1.0:1779690358.807880:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902049 is committed 00000001:00100000:1.0:1779690358.807886:0:57578:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000001:00080000:1.0:1779690358.807891:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902040 is committed 00000020:00000080:1.0:1779690358.807894:0:57578:0:(genops.c:906:class_export_put()) final put ffff9e30bfc90800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00080000:1.0:1779690358.807912:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018963 batchid updated 00000001:00080000:1.0:1779690358.807929:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902046 is committed 00000020:00080000:1.0:1779690358.807948:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018963 00000020:00080000:1.0:1779690358.807956:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018963 00000020:00000080:1.0:1779690358.809858:0:496:0:(genops.c:865:class_export_destroy()) destroying export ffff9e30bfc90800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 for lustre-MDT0000 00000020:00000080:1.0:1779690358.809920:0:496:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e30bfc94000 for lustre-MDT0000 00000001:00100000:0.0:1779690358.830450:0:7477:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00000080:0.0:1779690358.830468:0:7477:0:(genops.c:906:class_export_put()) final put ffff9e308602f800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 00000020:00000080:2.0:1779690358.831058:0:496:0:(genops.c:865:class_export_destroy()) destroying export ffff9e308602f800/4e142dd6-2774-4e7c-aac6-3ec8711f37a2 for lustre-OST0001 00000020:00000080:2.0:1779690358.831186:0:496:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e308602e800 for lustre-OST0001 00000040:00080000:1.0:1779690358.834035:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690358.834042:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690358.834086:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 13 count 12 00000040:00080000:1.0:1779690358.834092:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690358.834401:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492295424:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690358.834497:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f810f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1779690358.841565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690358.841591:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492295424:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690358.841600:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563520 00000100:00100000:0.0:1779690358.841607:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563520 00000100:00100000:0.0:1779690358.841662:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 300 00000100:00100000:0.0:1779690358.841674:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+25:98310:x1866137503563520:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690358.841703:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xd:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690358.841796:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+25:98310:x1866137503563520:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690358.841820:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 300 00000100:00100000:2.0:1779690358.846192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690358.849329:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563776 00000100:00100000:3.0:1779690358.849342:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563776 00000100:00100000:3.0:1779690358.849405:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 301 00000100:00100000:3.0:1779690358.849416:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+25:98310:x1866137503563776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690358.849436:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690358.849454:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed895 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.849542:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ddfb lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.849557:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ddfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.849570:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ddfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690358.849581:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xd:0x0]: returning size 0 00010000:00010000:3.0:1779690358.849739:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ddf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed895 expref: 28 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.849755:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ddfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed895 expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.849764:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:3.0:1779690358.849767:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690358.849771:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87c00, rc 0) 00000100:00100000:3.0:1779690358.849854:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503563776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 440us (3669us total) trans 12884902050 rc 0/0 00000100:00100000:3.0:1779690358.849862:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 301 00000100:00100000:2.0:1779690358.856982:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690358.857101:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503563904 00000100:00100000:1.0:1779690358.857110:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503563904 00000100:00100000:1.0:1779690358.857202:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18642 00000100:00100000:1.0:1779690358.857213:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+27:2391:x1866137503563904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690358.857227:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1779690358.857242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:1.0:1779690358.857253:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ddfb lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed895 expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690358.857282:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:1.0:1779690358.857288:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690358.857291:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564032 00000100:00100000:3.0:1779690358.857296:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564032 00000100:00100000:3.0:1779690358.857346:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6371 00000100:00100000:3.0:1779690358.857354:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503564032:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1779690358.857358:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+26:2391:x1866137503563904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 145us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690358.857367:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18642 00010000:00010000:3.0:1779690358.857389:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857404:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690358.857406:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690358.857411:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857424:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857452:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857466:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857474:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857481:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690358.857486:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857495:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857508:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.857515:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913de09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690358.857552:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503564032:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 199us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690358.857559:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6371 00000100:00080000:2.0:1779690358.857609:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690358.865365:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.865439:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564288 00000100:00100000:0.0:1779690358.865449:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564288 00000100:00100000:0.0:1779690358.865503:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00100000:0.0:1779690358.865514:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+26:98310:x1866137503564288:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690358.865708:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+26:98310:x1866137503564288:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690358.865716:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00100000:1.0:1779690358.875599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690358.875687:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564416 00000100:00100000:2.0:1779690358.875697:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564416 00000100:00100000:2.0:1779690358.875745:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6372 00000100:00100000:2.0:1779690358.875754:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503564416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690358.875769:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690358.875786:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023ff83c9/0xb4bb873a1913de10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed89c expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.876089:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690358.876091:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690358.876099:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ff83c9/0xb4bb873a1913de10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed89c expref: 22 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.876117:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023ff83c9/0xb4bb873a1913de10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed89c expref: 22 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.876129:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad600, rc 0) 00000100:00100000:2.0:1779690358.876192:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+22:2389:x1866137503564416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 439us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690358.876198:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6372 00000100:00100000:2.0:1779690358.880589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690358.880936:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564672 00000100:00100000:3.0:1779690358.880946:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564672 00000100:00100000:3.0:1779690358.881011:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 303 00000100:00100000:3.0:1779690358.881027:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+26:98310:x1866137503564672:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690358.881130:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+26:98310:x1866137503564672:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 106us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690358.881137:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 303 00000100:00100000:3.0:1779690358.887966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.889025:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564800 00000100:00100000:0.0:1779690358.889035:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564800 00000100:00100000:0.0:1779690358.889122:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 304 00000100:00100000:0.0:1779690358.889132:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+26:98310:x1866137503564800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690358.889155:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690358.889184:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913de17 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8a3 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889219:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889239:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889251:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889339:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913de17 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889355:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.889364:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:0.0:1779690358.889366:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690358.889370:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c600, rc 0) 00000100:00100000:0.0:1779690358.889434:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503564800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 303us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690358.889441:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 304 00000100:00100000:1.0:1779690358.902076:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690358.902132:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503564928 00000100:00100000:3.0:1779690358.902142:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503564928 00000100:00100000:3.0:1779690358.902207:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 305 00000100:00100000:3.0:1779690358.902217:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503564928:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690358.902246:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0xd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690358.902352:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503564928:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690358.902359:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 305 00000100:00100000:0.0:1779690358.923453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.923544:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565056 00000100:00100000:0.0:1779690358.923557:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565056 00000100:00100000:0.0:1779690358.923617:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6373 00000100:00100000:0.0:1779690358.923628:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503565056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690358.923672:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923688:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690358.923700:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690358.923706:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923721:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923752:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923760:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923769:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923777:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690358.923782:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923791:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923834:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690358.923843:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc92034/0xb4bb873a1913de25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690358.923982:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503565056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 357us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690358.923990:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6373 00000100:00100000:0.0:1779690358.942331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690358.942933:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565312 00000100:00100000:2.0:1779690358.942944:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565312 00000100:00100000:2.0:1779690358.943002:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 306 00000100:00100000:2.0:1779690358.943012:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503565312:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690358.943086:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.943099:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.943106:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.943130:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690358.943139:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 27 pid: 57559 timeout: 3186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690358.943149:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492295552:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690358.943240:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90821c00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690358.947000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690358.947032:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565440 00000100:00100000:3.0:1779690358.949789:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565440 00010000:00010000:3.0:1779690358.949961:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 28 pid: 57559 timeout: 3186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690358.950001:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3207 00000100:00100000:3.0:1779690358.950011:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+28:2392:x1866137503565440:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690358.950024:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690358.950030:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 28 pid: 57559 timeout: 3186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950044:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 28 pid: 57559 timeout: 3186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950073:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:3.0:1779690358.950079:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950088:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950096:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950114:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690358.950182:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+28:2392:x1866137503565440:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 172us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690358.950190:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3207 00010000:00010000:3.0:1779690358.950240:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913de1e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8a3 expref: 27 pid: 57559 timeout: 3186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690358.950255:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492295552:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690358.950522:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950533:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.950539:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951099:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951114:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951121:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951127:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690358.951132:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951140:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951151:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xd:0x0].0x0 (ffff9e2f883cb300) 00010000:00010000:3.0:1779690358.951154:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690358.951158:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690358.951174:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de2c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690358.951642:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503565312:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 8628us (9315us total) trans 12884902051 rc 0/0 00000100:00100000:3.0:1779690358.951652:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 306 00000040:00080000:1.0:1779690358.952408:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690358.952415:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690358.953197:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:1.0:1779690358.953206:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690358.953910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690358.954478:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565696 00000100:00100000:0.0:1779690358.954488:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565696 00000100:00100000:0.0:1779690358.954543:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:0.0:1779690358.954554:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98310:x1866137503565696:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690358.954890:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98310:x1866137503565696:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 338us (984us total) trans 12884902052 rc 0/0 00000100:00100000:0.0:1779690358.954898:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:0.0:1779690359.232570:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690359.232606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690359.232633:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565824 00000100:00100000:2.0:1779690359.232642:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565824 00000100:00100000:0.0:1779690359.232643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690359.232674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690359.232701:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690359.232704:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:2.0:1779690359.232717:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503565824:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690359.232729:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566336 00000100:00100000:0.0:1779690359.232734:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566336 00000100:00100000:2.0:1779690359.232787:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503565824:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690359.232831:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:0.0:1779690359.232855:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503565952 00000100:00100000:0.0:1779690359.232860:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503565952 00000100:00100000:0.0:1779690359.232891:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566208 00000100:00100000:0.0:1779690359.232894:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566208 00000100:00100000:0.0:1779690359.232919:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2765 00000100:00100000:0.0:1779690359.232926:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2389:x1866137503566336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690359.232949:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2766 00000100:00100000:0.0:1779690359.232959:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2389:x1866137503566336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690359.232963:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503565952:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690359.232977:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2765 00000100:00100000:0.0:1779690359.232994:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2767 00000100:00100000:0.0:1779690359.233003:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503566208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690359.233006:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503565952:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690359.233015:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2766 00000100:00100000:0.0:1779690359.233035:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503566208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690359.233041:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2767 00000100:00080000:0.0:1779690359.233064:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690359.233068:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690359.233126:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566080 00000100:00100000:3.0:1779690359.233130:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566080 00000100:00100000:3.0:1779690359.233178:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:3.0:1779690359.233185:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+24:2389:x1866137503566080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690359.233852:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+24:2389:x1866137503566080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 666us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690359.233861:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00080000:0.0:1779690359.234144:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690359.241081:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690360.136442:0:62039:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690360.136450:0:62039:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690360.136521:0:62039:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 13 count 12 00000040:00080000:1.0:1779690360.136528:0:62039:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690360.265893:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690360.803070:0:62090:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690360.803078:0:62090:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690360.803171:0:62090:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 13 count 12 00000040:00080000:0.0:1779690360.803176:0:62090:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690361.035936:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690361.035946:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690361.036260:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 13 count 11 00000040:00080000:2.0:1779690361.036268:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690361.289015:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690361.801010:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492295680:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.801075:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492295808:0@lo:400:kworker.0 00000100:00100000:3.0:1779690361.801099:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690361.801196:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492295680 00000100:00100000:1.0:1779690361.801204:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492295680 00000100:00100000:2.0:1779690361.801207:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492295936:0@lo:400:kworker.0 00000100:00100000:1.0:1779690361.801259:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1779690361.801268:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492295680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805372:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690361.805446:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492296320:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805474:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690361.805515:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1779690361.805522:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492296192:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805550:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690361.805586:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492296064:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805612:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690361.805638:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492296576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690361.805662:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690361.805706:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492295808 00000100:00100000:0.0:1779690361.805713:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492295808 00000100:00100000:0.0:1779690361.805778:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296320 00000100:00100000:0.0:1779690361.805782:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296320 00000100:00100000:0.0:1779690361.805820:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1779690361.805830:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492295808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805879:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492295808:12345-0@lo:400:kworker.0 Request processed in 50us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690361.805886:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1779690361.805903:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1779690361.805909:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492296320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.805934:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492296320:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690361.805940:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1779690361.805955:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296192 00000100:00100000:0.0:1779690361.805958:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296192 00000100:00100000:0.0:1779690361.805981:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296064 00000100:00100000:0.0:1779690361.805984:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296064 00000100:00100000:0.0:1779690361.806002:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1779690361.806008:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492296192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.806357:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492296192:12345-0@lo:400:kworker.0 Request processed in 349us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690361.806364:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1779690361.806376:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1779690361.806383:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492296064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.806417:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492296064:12345-0@lo:400:kworker.0 Request processed in 35us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690361.806433:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1779690361.806451:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296576 00000100:00100000:0.0:1779690361.806455:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296576 00000100:00100000:0.0:1779690361.806474:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1779690361.806479:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492296576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690361.806506:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690361.806534:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492296576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690361.806540:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00080000:0.0:1779690361.806556:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690361.806560:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690361.806562:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690361.806631:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492296064:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.806647:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492296576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690361.806677:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492296192:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.806687:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492295808:0@lo:400:kworker.0 00000100:00100000:0.0:1779690361.807014:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492296320:0@lo:400:kworker.0 00000100:00100000:1.0:1779690361.810276:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492295680:12345-0@lo:400:kworker.0 Request processed in 9000us (9169us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690361.810299:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1779690361.810535:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492295680:0@lo:400:kworker.0 00000100:00100000:2.0:1779690361.817875:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690361.817930:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492296448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690361.817965:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690361.818235:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296448 00000100:00100000:1.0:1779690361.818243:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296448 00000100:00100000:1.0:1779690361.818293:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1779690361.818302:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492296448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690361.818337:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690361.818385:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492296448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690361.818394:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1779690361.818522:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492296448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690361.820521:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492295936 00000100:00100000:3.0:1779690361.820532:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492295936 00000100:00100000:3.0:1779690361.820625:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1779690361.820635:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690361.820712:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492295936:12345-0@lo:400:kworker.0 Request processed in 79us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690361.820719:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1779690361.820769:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492295936:0@lo:400:kworker.0 00000100:00080000:2.0:1779690361.821352:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690362.312975:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690363.337975:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690363.916526:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902052 is committed 00000100:00100000:0.0:1779690364.352461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352554:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690364.352648:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566720 00000100:00100000:0.0:1779690364.352657:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566720 00000100:00100000:0.0:1779690364.352707:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503567232 00000100:00100000:0.0:1779690364.352709:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503567232 00000100:00100000:0.0:1779690364.352726:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566848 00000100:00100000:0.0:1779690364.352728:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566848 00000100:00100000:0.0:1779690364.352743:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503567104 00000100:00100000:0.0:1779690364.352745:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503567104 00000100:00100000:0.0:1779690364.352765:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2770 00000100:00100000:0.0:1779690364.352773:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503566720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.352870:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503566720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.352878:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2770 00000100:00100000:0.0:1779690364.352894:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2771 00000100:00100000:0.0:1779690364.352900:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2390:x1866137503567232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.352924:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2390:x1866137503567232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.352930:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2771 00000100:00100000:0.0:1779690364.352940:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2772 00000100:00100000:0.0:1779690364.352945:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503566848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.352966:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503566848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.352972:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2772 00000100:00100000:0.0:1779690364.352981:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2773 00000100:00100000:0.0:1779690364.352987:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503567104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.353017:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503567104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.353023:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2773 00000100:00100000:0.0:1779690364.353040:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566976 00000100:00100000:0.0:1779690364.353044:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566976 00000100:00100000:0.0:1779690364.353072:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566592 00000100:00100000:0.0:1779690364.353075:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566592 00000100:00100000:0.0:1779690364.353094:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:0.0:1779690364.353100:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:2390:x1866137503566976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.353139:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:2390:x1866137503566976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.353146:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:0.0:1779690364.353157:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:0.0:1779690364.353163:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+25:2390:x1866137503566592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690364.353191:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+25:2390:x1866137503566592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690364.353197:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00080000:0.0:1779690364.353227:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690364.353231:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690364.353233:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690364.353507:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503566464 00000100:00100000:1.0:1779690364.353512:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503566464 00000100:00100000:1.0:1779690364.353550:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:1.0:1779690364.353557:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503566464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690364.353598:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503566464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690364.353605:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00010000:00010000:0.0:1779690364.361125:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690365.176888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690365.177120:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503567360 00000100:00100000:3.0:1779690365.177130:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503567360 00000100:00100000:3.0:1779690365.177422:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 307 00000100:00100000:3.0:1779690365.177623:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+25:98269:x1866137503567360:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1779690365.177725:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+25:98269:x1866137503567360:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 293us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690365.177732:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 307 00000100:00100000:0.0:1779690365.184509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690365.184578:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503567616 00000100:00100000:3.0:1779690365.184588:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503567616 00000100:00100000:3.0:1779690365.184697:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1779690365.184707:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+25:98269:x1866137503567616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690365.185321:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+26:98269:x1866137503567616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 613us (815us total) trans 12884902053 rc 0/0 00000100:00100000:3.0:1779690365.185330:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00010000:00010000:2.0:1779690365.385009:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690366.409004:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690366.643038:0:62289:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 200: Register/Cancel archive ========== 02:26:05 (1779690365) 00000100:00100000:3.0:1779690366.689646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.689682:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503567744 00000100:00100000:3.0:1779690366.689692:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503567744 00000100:00100000:3.0:1779690366.689749:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 308 00000100:00100000:3.0:1779690366.689759:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+24:98906:x1866137503567744:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690366.689778:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690366.689797:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8aa expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689879:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689894:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689906:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689937:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689943:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.689955:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690333:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690340:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690346:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690353:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.690356:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690363:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690375:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:3.0:1779690366.690378:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.690382:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690388:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690397:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690401:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690410:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690414:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.690415:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690419:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690424:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57593993 (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690366.690426:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.690428:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690432:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690454:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8aa expref: 25 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690460:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:3.0:1779690366.690462:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.690464:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8aa expref: 25 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.690471:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87a00, rc 0) 00000100:00100000:3.0:1779690366.690518:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+24:98906:x1866137503567744:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 762us (883us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690366.690530:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 308 00000100:00080000:3.0:1779690366.690675:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690366.696262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.696353:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568000 00000100:00100000:3.0:1779690366.696363:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568000 00000100:00100000:3.0:1779690366.696422:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 309 00000100:00100000:3.0:1779690366.696432:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:98906:x1866137503568000:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1779690366.696481:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690366.696504:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dd61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed85d expref: 24 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.696521:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:3.0:1779690366.696527:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690366.696790:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.696823:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 25 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.696833:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.696866:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 25 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.696880:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 25 pid: 57560 timeout: 3194 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690366.696893:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492296704:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690366.696981:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089b27b40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690366.700879:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492296704:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690366.700910:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690366.704072:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690366.704263:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568128 00000100:00100000:0.0:1779690366.704273:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568128 00000100:00080000:1.0:1779690366.704324:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690366.704335:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 26 pid: 57560 timeout: 3194 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690366.704375:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3208 00000100:00100000:0.0:1779690366.704386:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+26:2392:x1866137503568128:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690366.704400:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690366.704407:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 26 pid: 57560 timeout: 3194 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704419:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 26 pid: 57560 timeout: 3194 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704443:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913dc7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed81e expref: 26 pid: 57560 timeout: 3194 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704468:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:0.0:1779690366.704474:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704483:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704491:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.704522:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690366.704647:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.704656:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.704681:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690366.704684:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+25:2392:x1866137503568128:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 298us (619us total) trans 0 rc 0/0 00010000:00010000:1.0:1779690366.704701:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690366.704701:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3208 00010000:00010000:1.0:1779690366.704718:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690366.706023:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x74:0x0]: returning size 512 00010000:00010000:1.0:1779690366.706035:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706044:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706051:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706056:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690366.706061:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706069:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706082:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54400) 00010000:00010000:1.0:1779690366.706097:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690366.706102:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.706108:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de48 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690366.706126:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000012e8926f reply state 00000000862d92ab transno 12884902054 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690366.706146:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690366.706229:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+25:98906:x1866137503568000:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 9795us (9973us total) trans 12884902054 rc 0/0 00000100:00100000:1.0:1779690366.706238:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 309 00010000:00010000:1.0:1779690366.715903:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715920:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715928:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715934:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690366.715939:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715946:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715964:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57593993 (ffff9e2f903c9500) 00010000:00010000:1.0:1779690366.715967:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690366.715971:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.715978:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913de4f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690366.753184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690366.753259:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568256 00000100:00100000:0.0:1779690366.753268:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568256 00000100:00100000:0.0:1779690366.753325:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 310 00000100:00100000:0.0:1779690366.753335:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+25:98915:x1866137503568256:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690366.753357:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690366.753377:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913de56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8b1 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753438:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753451:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753470:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690366.753528:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:0.0:1779690366.753532:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 97 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690366.753561:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753585:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913de56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b1 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753601:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b1 expref: 26 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690366.753624:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690366.753626:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690366.753630:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690366.753693:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+26:98915:x1866137503568256:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 358us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690366.753700:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 310 00000100:00100000:2.0:1779690366.761128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690366.763206:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568512 00000100:00100000:1.0:1779690366.763217:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568512 00000100:00100000:1.0:1779690366.763277:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 311 00000100:00100000:1.0:1779690366.763287:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+26:98915:x1866137503568512:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:1.0:1779690366.763339:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690366.763365:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913de5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b1 expref: 26 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.763381:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:1.0:1779690366.763391:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690366.763721:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+25:98915:x1866137503568512:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 434us (2599us total) trans 0 rc -17/-17 00000100:00100000:1.0:1779690366.763729:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 311 00000100:00100000:1.0:1779690366.765994:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.766062:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568640 00000100:00100000:3.0:1779690366.766070:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568640 00000100:00100000:3.0:1779690366.766137:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 312 00000100:00100000:3.0:1779690366.766148:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+25:98915:x1866137503568640:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1779690366.766164:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690366.766208:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8b8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766268:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766282:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766292:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690366.766347:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:3.0:1779690366.766351:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 97 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690366.766374:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766397:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766412:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 26 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.766433:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690366.766436:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690366.766439:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87c00, rc 0) 00000100:00100000:3.0:1779690366.766496:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+26:98915:x1866137503568640:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 350us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690366.766503:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 312 00000100:00100000:3.0:1779690366.771278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690366.771354:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568768 00000100:00100000:2.0:1779690366.771364:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568768 00000100:00100000:2.0:1779690366.771416:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 313 00000100:00100000:2.0:1779690366.771426:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+26:98915:x1866137503568768:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690366.771444:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690366.771475:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913de72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8bf expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771560:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771574:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771586:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771599:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771606:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771612:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771708:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771717:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771725:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690366.771760:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x74:0x0]: returning size 512 00000004:00200000:2.0:1779690366.771764:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690366.771783:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771834:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771842:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771848:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771854:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690366.771858:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771865:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771877:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:2.0:1779690366.771880:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690366.771884:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771890:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913de79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771903:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771909:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771915:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771926:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690366.771929:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771935:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771943:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57593993 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690366.771946:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690366.771948:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771954:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913de80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771983:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913de72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8bf expref: 28 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.771995:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8bf expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690366.772002:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690366.772004:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690366.772007:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ada00, rc 0) 00000100:00100000:2.0:1779690366.772064:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98915:x1866137503568768:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 639us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690366.772071:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 313 00000100:00100000:2.0:1779690366.789095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.789170:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503568896 00000100:00100000:3.0:1779690366.789180:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503568896 00000100:00100000:3.0:1779690366.789252:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 314 00000100:00100000:3.0:1779690366.789263:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98919:x1866137503568896:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690366.789284:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690366.789303:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de8e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8c6 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789380:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789396:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789407:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789487:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789496:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789509:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789590:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789598:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789604:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789610:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.789614:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789621:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789633:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690366.789636:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.789640:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789646:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913de95 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789658:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789664:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789676:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789681:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.789683:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789688:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789696:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x32d46f4f (ffff9e2f883cb900) 00010000:00010000:3.0:1779690366.789699:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.789701:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789707:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913de9c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789740:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de8e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8c6 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789750:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690366.789753:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.789756:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913de8e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8c6 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.789765:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87a00, rc 0) 00000100:00100000:3.0:1779690366.789860:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98919:x1866137503568896:12345-192.168.203.5@tcp:101:rm.0 Request processed in 599us (783us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690366.789876:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 314 00000100:00100000:2.0:1779690366.803257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.803330:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503569152 00000100:00100000:3.0:1779690366.803339:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503569152 00000100:00100000:3.0:1779690366.803397:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 315 00000100:00100000:3.0:1779690366.803409:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98921:x1866137503569152:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1779690366.803429:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690366.803432:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690366.803457:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913de87 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8bf expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803482:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690366.803492:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690366.803507:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913dea3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8cd expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803638:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803652:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803661:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803673:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803679:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.803697:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690366.804343:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e7:0x0], index 1: 0 00010000:00010000:3.0:1779690366.804505:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913deb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804515:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804524:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804555:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804563:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804569:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804575:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.804579:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804586:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804596:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f883cb900) 00010000:00010000:3.0:1779690366.804599:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.804611:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804617:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913deaa lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690366.804629:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007ddb6373 reply state 0000000011ca0543 transno 12884902055 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690366.804637:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690366.804665:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913dea3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8cd expref: 29 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804682:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5c00/0xb4bb873a1913deb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8cd expref: 28 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.804690:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x10:0x0].0x0 (ffff9e2f883cb400) 00010000:00010000:3.0:1779690366.804692:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690366.804694:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5c00, rc 0) 00000100:00100000:3.0:1779690366.804763:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+29:98921:x1866137503569152:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1357us (1514us total) trans 12884902055 rc 0/0 00000100:00100000:3.0:1779690366.804772:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 315 00010000:00010000:1.0:1779690366.806917:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806934:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806941:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806947:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690366.806951:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806959:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806973:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x32d46f4f (ffff9e2f883cba00) 00010000:00010000:1.0:1779690366.806987:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690366.806992:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690366.806998:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913deb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690366.814700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690366.814741:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503569408 00000100:00100000:1.0:1779690366.814750:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503569408 00000100:00100000:1.0:1779690366.814797:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:1.0:1779690366.814821:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90558c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+28:98921:x1866137503569408:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:1.0:1779690366.815150:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90558c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+29:98921:x1866137503569408:12345-192.168.203.5@tcp:35:dd.0 Request processed in 344us (459us total) trans 12884902056 rc 0/0 00000100:00100000:1.0:1779690366.815158:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1779690366.848604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690366.849958:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503569536 00000100:00100000:3.0:1779690366.849969:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503569536 00000100:00100000:3.0:1779690366.850051:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 316 00000100:00100000:3.0:1779690366.850062:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+29:98922:x1866137503569536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690366.850093:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690366.850111:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8d4 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850180:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850195:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850204:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850218:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850223:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850229:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850400:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dedb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850409:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850417:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690366.850512:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x74:0x0]: returning size 512 00000004:00200000:3.0:1779690366.850516:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690366.850539:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850560:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850566:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850572:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850577:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.850581:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850588:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850599:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690366.850602:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.850606:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850612:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913decd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850622:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850627:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850632:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850642:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690366.850645:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850651:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850658:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57593993 (ffff9e2f883cb900) 00010000:00010000:3.0:1779690366.850661:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690366.850664:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850670:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ded4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850698:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8d4 expref: 31 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850712:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5400/0xb4bb873a1913dedb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8d4 expref: 30 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690366.850719:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f883cbf00) 00010000:00010000:3.0:1779690366.850722:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690366.850724:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5400, rc 0) 00000100:00100000:3.0:1779690366.850792:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+30:98922:x1866137503569536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 732us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690366.850799:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 316 00000100:00100000:0.0:1779690366.922009:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492297216:0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.922080:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690366.922144:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492296832:0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.922158:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690366.922167:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492297088:0@lo:400:kworker.0 00000100:00100000:1.0:1779690366.922296:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492296960:0@lo:400:kworker.0 00000100:00100000:2.0:1779690366.922363:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492297600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690366.922407:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690366.922429:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690366.922454:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690366.922486:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297216 00000100:00100000:0.0:1779690366.922493:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297216 00000100:00100000:0.0:1779690366.922547:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1779690366.922556:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492297216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.922605:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492297216:12345-0@lo:400:kworker.0 Request processed in 50us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690366.922611:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1779690366.922632:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297728 00000100:00100000:0.0:1779690366.922635:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297728 00000100:00100000:0.0:1779690366.922664:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1779690366.922671:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492297728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690366.922695:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690366.922743:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492297728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690366.922749:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1779690366.922796:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690366.922831:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492297216:0@lo:400:kworker.0 00000100:00080000:0.0:1779690366.922877:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690366.928310:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690366.928372:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492297344:0@lo:400:kworker.0 00000100:00100000:3.0:1779690366.928431:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690366.928482:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297088 00000100:00100000:3.0:1779690366.928489:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297088 00000100:00100000:2.0:1779690366.928558:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690366.928605:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297344 00000100:00100000:2.0:1779690366.928609:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297344 00000100:00100000:0.0:1779690366.928904:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296832 00000100:00100000:0.0:1779690366.928910:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296832 00000100:00100000:0.0:1779690366.928951:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1779690366.928960:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492296832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.929014:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492296832:12345-0@lo:400:kworker.0 Request processed in 56us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690366.929021:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1779690366.929065:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690366.929097:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492297472:0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.929117:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690366.929142:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492296960 00000100:00100000:0.0:1779690366.929145:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492296960 00000100:00100000:3.0:1779690366.929355:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297472 00000100:00100000:3.0:1779690366.929360:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297472 00000100:00100000:3.0:1779690366.929373:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1779690366.929380:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690366.929419:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492297088:12345-0@lo:400:kworker.0 Request processed in 39us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690366.929425:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1779690366.929440:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1779690366.929447:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690366.929475:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492297472:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690366.929480:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1779690366.929510:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492296832:0@lo:400:kworker.0 00000100:00100000:3.0:1779690366.930282:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492297088:0@lo:400:kworker.0 00000100:00100000:3.0:1779690366.930307:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492297472:0@lo:400:kworker.0 00000100:00100000:0.0:1779690366.933285:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1779690366.933299:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492296960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1779690366.933536:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690366.933542:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690366.933558:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492297600 00000100:00100000:1.0:1779690366.933565:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492297600 00000100:00100000:1.0:1779690366.933603:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1779690366.933611:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492297600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690366.933642:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690366.933867:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:2.0:1779690366.933875:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492297344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690366.934541:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492297344:12345-0@lo:400:kworker.0 Request processed in 664us (6107us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690366.934549:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:1.0:1779690366.935065:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492297600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1454us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690366.935074:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1779690366.935119:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492297344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690366.935189:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492297600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690366.935742:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492296960:12345-0@lo:400:kworker.0 Request processed in 2445us (6674us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690366.935758:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1779690366.935777:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492296960:0@lo:400:kworker.0 00000100:00100000:2.0:1779690367.041118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690367.041312:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503569792 00000100:00100000:3.0:1779690367.041322:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503569792 00000100:00100000:3.0:1779690367.041395:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 317 00000100:00100000:3.0:1779690367.041405:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+30:98948:x1866137503569792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690367.041555:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690367.041650:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8db expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.041947:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.041964:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.041976:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.041990:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.041997:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.042003:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043052:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913def7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043067:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913def7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043075:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913def7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690367.043106:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1779690367.043576:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043585:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043591:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043597:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690367.043601:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043609:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043622:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:3.0:1779690367.043624:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690367.043629:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043635:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913dee9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043647:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043653:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043683:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043688:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690367.043691:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043698:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043705:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f883cb900) 00010000:00010000:3.0:1779690367.043708:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690367.043711:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.043716:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913def0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.044101:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913dee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8db expref: 33 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.044117:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913def7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8db expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.044650:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690367.044653:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690367.044656:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5800, rc 0) 00000100:00100000:3.0:1779690367.044939:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+32:98948:x1866137503569792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3533us (3827us total) trans 12884902057 rc 0/0 00000100:00100000:3.0:1779690367.044958:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 317 00000100:00100000:1.0:1779690367.067128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690367.067172:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690367.067291:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570048 00000100:00100000:2.0:1779690367.067300:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570048 00000100:00100000:2.0:1779690367.067357:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 318 00000100:00100000:2.0:1779690367.067377:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:98948:x1866137503570048:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690367.067498:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:98948:x1866137503570048:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 132us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690367.067506:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 318 00000100:00100000:3.0:1779690367.067759:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503569920 00000100:00100000:3.0:1779690367.067764:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503569920 00000100:00100000:3.0:1779690367.067835:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18643 00000100:00100000:3.0:1779690367.067843:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+32:2390:x1866137503569920:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690367.067854:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690367.067878:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5800/0xb4bb873a1913def7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8db expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.067896:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690367.067901:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690367.067924:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+31:2390:x1866137503569920:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 83us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690367.067931:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18643 00000040:00080000:1.0:1779690367.177505:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690367.177514:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690367.179335:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:1.0:1779690367.179351:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690367.212396:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690367.212505:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570176 00000100:00100000:0.0:1779690367.212515:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570176 00000100:00100000:0.0:1779690367.212573:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 319 00000100:00100000:0.0:1779690367.212585:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+24:98957:x1866137503570176:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690367.212626:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690367.212647:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8e2 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.212708:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.213051:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.213063:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690367.213132:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:0.0:1779690367.213136:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 97 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690367.213160:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.213183:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8e2 expref: 26 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.213201:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8e2 expref: 25 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.213209:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:0.0:1779690367.213265:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690367.213270:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d400, rc 0) 00000100:00100000:0.0:1779690367.213394:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+25:98957:x1866137503570176:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 812us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690367.213402:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 319 00000100:00100000:1.0:1779690367.220478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690367.220942:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570304 00000100:00100000:2.0:1779690367.220953:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570304 00000100:00100000:2.0:1779690367.221014:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 320 00000100:00100000:2.0:1779690367.221024:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+25:98957:x1866137503570304:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690367.221045:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690367.221152:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913df13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8e9 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221225:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221240:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221251:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221456:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221467:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221474:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221967:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913df28 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221976:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913df28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.221984:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913df28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690367.222016:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x74:0x0]: returning size 512 00000004:00200000:2.0:1779690367.222020:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690367.222043:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913df28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222065:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222071:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222147:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222155:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690367.222159:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222167:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222179:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:2.0:1779690367.222182:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690367.222196:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222202:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913df1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222216:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222222:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222227:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222239:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690367.222242:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222248:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222256:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57593993 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690367.222367:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690367.222371:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222378:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913df21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57593993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222410:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913df13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8e9 expref: 27 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222422:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ada00/0xb4bb873a1913df28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8e9 expref: 26 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690367.222430:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f883cbf00) 00010000:00010000:2.0:1779690367.222432:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690367.222434:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ada00, rc 0) 00000100:00100000:2.0:1779690367.222700:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+26:98957:x1866137503570304:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1677us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690367.222708:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 320 00000100:00100000:3.0:1779690367.226165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690367.226382:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570432 00000100:00100000:0.0:1779690367.226392:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570432 00000100:00100000:0.0:1779690367.226564:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 321 00000100:00100000:0.0:1779690367.226579:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+26:98957:x1866137503570432:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690367.226610:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690367.226629:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df2f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8f0 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226690:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226703:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226714:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226727:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226733:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226739:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226857:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226865:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226889:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690367.226927:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x10:0x0]: returning size 0 00000004:00200000:0.0:1779690367.226931:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690367.226949:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226959:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226968:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226974:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226980:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226986:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690367.226990:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.226997:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227007:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f883cbf00) 00010000:00010000:0.0:1779690367.227010:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690367.227015:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227031:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913df36 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227046:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227052:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227057:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227061:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690367.227064:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227070:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227256:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x32d46f4f (ffff9e308bf54a00) 00010000:00010000:0.0:1779690367.227317:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690367.227322:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227327:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913df3d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x32d46f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227361:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df2f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x74:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8f0 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227387:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d200/0xb4bb873a1913df44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8f0 expref: 27 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690367.227394:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x10:0x0].0x0 (ffff9e2f883cb400) 00010000:00010000:0.0:1779690367.227396:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690367.227398:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d200, rc 0) 00000100:00100000:0.0:1779690367.227460:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+27:98957:x1866137503570432:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 885us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690367.230733:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690367.231013:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570560 00000100:00100000:3.0:1779690367.231022:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570560 00000100:00100000:3.0:1779690367.231106:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6374 00000100:00100000:3.0:1779690367.231117:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+13:2391:x1866137503570560:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690367.231134:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690367.231155:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913df4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8f7 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690367.231181:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690367.231212:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690367.231227:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690367.231235:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913df4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8f7 expref: 14 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.231254:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913df4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8f7 expref: 14 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690367.231452:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690367.231517:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5800, rc 0) 00000100:00100000:3.0:1779690367.231589:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+14:2391:x1866137503570560:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 474us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690367.231597:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6374 00000100:00100000:1.0:1779690367.235741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690367.235940:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570688 00000100:00100000:3.0:1779690367.235951:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570688 00000100:00100000:0.0:1779690367.236185:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 321 00000100:00100000:3.0:1779690367.236775:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 322 00000100:00100000:3.0:1779690367.236788:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:98957:x1866137503570688:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690367.236836:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690367.236856:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed8fe expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.236918:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913df59 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.236932:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913df59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.236943:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913df59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690367.237001:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x74:0x0]: returning size 512 00000004:00200000:3.0:1779690367.237016:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690367.237045:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913df59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.237071:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8fe expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.237318:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4a00/0xb4bb873a1913df59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8fe expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690367.237327:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x74:0x0].0x0 (ffff9e2f883cbf00) 00010000:00010000:3.0:1779690367.237330:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690367.237333:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4a00, rc 0) 00000100:00100000:3.0:1779690367.237440:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:98957:x1866137503570688:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 655us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690367.237447:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 322 00000100:00100000:1.0:1779690367.244707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690367.245179:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503570944 00000100:00100000:2.0:1779690367.245320:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503570944 00000100:00100000:2.0:1779690367.245411:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 323 00000100:00100000:2.0:1779690367.245422:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+28:98957:x1866137503570944:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690367.245939:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].13, 136 off9960 00000100:00100000:2.0:1779690367.246072:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+28:98957:x1866137503570944:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 651us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690367.246089:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 323 00010000:00010000:0.0:1779690367.438886:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690367.836778:0:62338:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690367.836787:0:62338:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690367.836963:0:62338:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 14 count 12 00000040:00080000:1.0:1779690367.836970:0:62338:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690368.201793:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690368.201801:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690368.201856:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 14 count 12 00000040:00080000:1.0:1779690368.201864:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690368.202118:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492297856:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690368.203078:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1779690368.210359:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492297856:192.168.203.5@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1779690368.457182:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690369.048930:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902056 is committed 00000001:00080000:3.0:1779690369.048942:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902054 is committed 00000001:00080000:3.0:1779690369.048956:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902057 is committed 00000100:00100000:3.0:1779690369.473591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.473785:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571200 00000100:00100000:0.0:1779690369.473790:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571456 00000100:00100000:3.0:1779690369.473793:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571200 00000100:00100000:0.0:1779690369.473796:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571456 00000100:00100000:1.0:1779690369.473886:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571584 00000100:00100000:1.0:1779690369.473890:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571584 00000100:00100000:0.0:1779690369.473941:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571712 00000100:00100000:0.0:1779690369.473945:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571712 00000100:00100000:3.0:1779690369.475041:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:3.0:1779690369.475068:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:2389:x1866137503571200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690369.475146:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:2389:x1866137503571200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 90us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690369.475154:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:2.0:1779690369.476287:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571328 00000100:00100000:2.0:1779690369.476295:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571328 00000100:00100000:2.0:1779690369.476400:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571840 00000100:00100000:2.0:1779690369.476404:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571840 00000100:00100000:2.0:1779690369.476434:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2776 00000100:00100000:2.0:1779690369.476442:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+22:2389:x1866137503571456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690369.476487:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+22:2389:x1866137503571456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690369.476495:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2776 00000100:00100000:3.0:1779690369.476519:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2777 00000100:00100000:3.0:1779690369.476530:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503571328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690369.476560:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503571328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690369.476595:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2778 00000100:00100000:2.0:1779690369.476604:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503571840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690369.476630:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503571840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690369.476637:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2778 00000100:00100000:0.0:1779690369.479200:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2779 00000100:00100000:0.0:1779690369.479214:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503571712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690369.479280:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:0.0:1779690369.479281:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503571712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690369.479287:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2779 00000100:00100000:1.0:1779690369.479289:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+27:2389:x1866137503571584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690369.479317:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+27:2389:x1866137503571584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690369.479323:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:1.0:1779690369.479356:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503571072 00000100:00100000:1.0:1779690369.479362:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503571072 00000100:00100000:1.0:1779690369.479388:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:1.0:1779690369.479393:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503571072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690369.479416:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503571072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690369.479422:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00080000:1.0:1779690369.479448:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690369.479453:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690369.479456:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1779690369.482747:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690369.483267:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2777 00000040:00080000:3.0:1779690369.545942:0:62391:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690369.545950:0:62391:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690369.546028:0:62391:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 14 count 12 00000040:00080000:3.0:1779690369.546034:0:62391:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690369.603677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690369.603764:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572096 00000100:00100000:3.0:1779690369.603774:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572096 00000100:00100000:3.0:1779690369.605445:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 324 00000100:00100000:3.0:1779690369.605462:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:98976:x1866137503572096:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690369.605584:0:57561:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690369.605588:0:57561:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690369.605624:0:57561:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 14 count 12 00000040:00080000:3.0:1779690369.605631:0:57561:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690369.605954:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].14, 136 off10096 00000100:00100000:3.0:1779690369.606045:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:98976:x1866137503572096:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 588us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690369.606052:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 324 00000040:00080000:1.0:1779690370.253324:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690370.253333:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690370.253370:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 15 count 13 00000040:00080000:1.0:1779690370.253377:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690370.253527:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492297984:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690370.253623:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1779690370.267669:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492297984:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1779690370.350777:0:62442:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690370.350786:0:62442:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690370.351014:0:62442:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 15 count 13 00000040:00080000:1.0:1779690370.351020:0:62442:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690370.505424:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690370.525701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690370.525777:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572224 00000100:00100000:1.0:1779690370.525789:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572224 00000100:00100000:1.0:1779690370.526040:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 325 00000100:00100000:1.0:1779690370.526061:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:98993:x1866137503572224:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690370.526090:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690370.526218:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:98993:x1866137503572224:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 168us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690370.526239:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 325 00000100:00100000:2.0:1779690370.527280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690370.527345:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572352 00000100:00100000:3.0:1779690370.527352:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572352 00000100:00100000:3.0:1779690370.527396:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 326 00000100:00100000:3.0:1779690370.527404:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98992:x1866137503572352:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690370.527425:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690370.527496:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98992:x1866137503572352:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690370.527504:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 326 00000100:00100000:3.0:1779690370.533541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690370.535008:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572608 00000100:00100000:0.0:1779690370.535021:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572608 00000100:00100000:0.0:1779690370.535088:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 327 00000100:00100000:0.0:1779690370.535098:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+27:98992:x1866137503572608:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690370.535117:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690370.535148:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed905 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690370.535243:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913df67 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690370.535258:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690370.535269:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690370.535280:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x10:0x0]: returning size 0 00010000:00010000:0.0:1779690370.535444:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913df60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed905 expref: 30 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690370.535461:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913df67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed905 expref: 29 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690370.535468:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x10:0x0].0x0 (ffff9e2f883cb400) 00010000:00010000:0.0:1779690370.535471:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690370.535474:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:0.0:1779690370.535535:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+29:98992:x1866137503572608:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 438us (2001us total) trans 12884902058 rc 0/0 00000100:00100000:0.0:1779690370.535542:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 327 00000100:00100000:3.0:1779690370.541260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690370.541362:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572736 00000100:00100000:2.0:1779690370.541383:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572736 00000100:00100000:2.0:1779690370.541440:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18644 00000100:00100000:2.0:1779690370.541449:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+29:2392:x1866137503572736:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690370.541463:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690370.541488:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913df67 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed905 expref: 29 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690370.541504:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x10:0x0].0x0 (ffff9e2f883cb400) 00010000:00010000:2.0:1779690370.541509:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690370.541568:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+28:2392:x1866137503572736:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 119us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690370.541576:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18644 00000100:00100000:2.0:1779690370.544190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690370.544298:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503572864 00000100:00100000:3.0:1779690370.544308:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503572864 00000100:00100000:3.0:1779690370.544355:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6375 00000100:00100000:3.0:1779690370.544365:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+22:2389:x1866137503572864:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690370.544407:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544423:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690370.544425:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690370.544430:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544443:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544475:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544499:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544507:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544514:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690370.544518:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544526:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544541:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690370.544549:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913df75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690370.544990:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+22:2389:x1866137503572864:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 626us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690370.544998:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6375 00000100:00100000:3.0:1779690370.552564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690370.552662:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503573120 00000100:00100000:1.0:1779690370.552671:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503573120 00000100:00100000:1.0:1779690370.552732:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 328 00000100:00100000:1.0:1779690370.552742:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98992:x1866137503573120:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690370.552896:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98992:x1866137503573120:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 156us (340us total) trans 0 rc -125/-125 00000100:00100000:1.0:1779690370.552904:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 328 00000100:00100000:1.0:1779690370.555080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690370.557551:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503573376 00000100:00100000:2.0:1779690370.557564:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503573376 00000100:00100000:2.0:1779690370.557636:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:2.0:1779690370.557647:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+28:98992:x1866137503573376:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690370.557941:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+29:98992:x1866137503573376:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 295us (2865us total) trans 12884902059 rc 0/0 00000100:00100000:2.0:1779690370.557949:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:2.0:1779690370.564589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690370.564674:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503573632 00000100:00100000:1.0:1779690370.564683:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503573632 00000100:00100000:1.0:1779690370.564784:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 329 00000100:00100000:1.0:1779690370.564796:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+29:98992:x1866137503573632:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690370.564894:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564910:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564920:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564947:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564954:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564978:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564983:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690370.564987:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.564994:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.565005:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x10:0x0].0x0 (ffff9e2f883cb400) 00010000:00010000:1.0:1779690370.565008:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690370.565012:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690370.565018:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913df7c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690370.565695:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+29:98992:x1866137503573632:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 900us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690370.565705:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 329 00000040:00080000:1.0:1779690370.567861:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690370.567868:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690370.569633:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:1.0:1779690370.569648:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690371.306716:0:62493:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690371.306730:0:62493:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690371.307003:0:62493:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 15 count 13 00000040:00080000:3.0:1779690371.307009:0:62493:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690371.528953:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690371.593078:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690371.593087:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690371.593879:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 15 count 11 00000040:00080000:1.0:1779690371.593888:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690372.041138:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492298112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690372.041209:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690372.041466:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298112 00000100:00100000:0.0:1779690372.041475:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298112 00000100:00100000:0.0:1779690372.041533:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1779690372.041542:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492298112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690372.041592:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690372.041637:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492298112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690372.041644:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00080000:0.0:1779690372.041684:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690372.041930:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492298240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690372.041962:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690372.042050:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492298112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690372.042320:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492298368:0@lo:400:kworker.0 00000100:00100000:3.0:1779690372.042354:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690372.042390:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690372.042395:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492298496:0@lo:400:kworker.0 00000100:00100000:3.0:1779690372.042438:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690372.042471:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298496 00000100:00100000:3.0:1779690372.042475:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298496 00000100:00100000:3.0:1779690372.042511:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1779690372.042519:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f91332450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492298496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690372.042556:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f91332450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492298496:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690372.042563:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1779690372.044216:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492298496:0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044568:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492298752:0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044616:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690372.044659:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690372.044677:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492298624:0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044699:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690372.044726:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298752 00000100:00100000:2.0:1779690372.044731:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298752 00000100:00100000:2.0:1779690372.044762:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298624 00000100:00100000:2.0:1779690372.044765:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298624 00000100:00100000:2.0:1779690372.044783:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1779690372.044790:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492298752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044852:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492298752:12345-0@lo:400:kworker.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690372.044858:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1779690372.044871:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1779690372.044875:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044896:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492298624:12345-0@lo:400:kworker.0 Request processed in 22us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690372.044902:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1779690372.044931:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492298624:0@lo:400:kworker.0 00000100:00100000:2.0:1779690372.044939:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492298752:0@lo:400:kworker.0 00000100:00100000:1.0:1779690372.045171:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298368 00000100:00100000:1.0:1779690372.045176:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298368 00000100:00100000:1.0:1779690372.045212:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1779690372.045219:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492298368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690372.045255:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492298368:12345-0@lo:400:kworker.0 Request processed in 37us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690372.045262:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1779690372.045340:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492298240 00000100:00100000:0.0:1779690372.045345:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492298240 00000100:00100000:0.0:1779690372.045380:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1779690372.045387:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492298240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690372.045422:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690372.045459:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492298240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690372.045464:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:0.0:1779690372.045479:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690372.045483:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690372.045504:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492298240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690372.045987:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492298368:0@lo:400:kworker.0 00010000:00010000:2.0:1779690372.552896:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690373.577025:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690374.159241:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902058 is committed 00000001:00080000:0.0:1779690374.159492:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902059 is committed 00010000:00010000:2.0:1779690374.601427:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690374.601501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601533:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601571:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690374.601667:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574016 00000100:00100000:2.0:1779690374.601676:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574016 00000100:00100000:2.0:1779690374.601725:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574528 00000100:00100000:2.0:1779690374.601729:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574528 00000100:00100000:2.0:1779690374.601747:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574144 00000100:00100000:2.0:1779690374.601750:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574144 00000100:00100000:2.0:1779690374.601766:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574400 00000100:00100000:2.0:1779690374.601768:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574400 00000100:00100000:2.0:1779690374.601788:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2780 00000100:00100000:2.0:1779690374.601797:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503574016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.601881:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503574016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 84us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.601887:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2780 00000100:00100000:2.0:1779690374.601904:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2781 00000100:00100000:2.0:1779690374.601910:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+14:2390:x1866137503574528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.601932:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+14:2390:x1866137503574528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.601938:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2781 00000100:00100000:2.0:1779690374.601950:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2782 00000100:00100000:2.0:1779690374.601955:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503574144:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.601976:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+22:2390:x1866137503574144:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.601993:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2782 00000100:00100000:2.0:1779690374.602016:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2783 00000100:00100000:2.0:1779690374.602023:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503574400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.602050:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503574400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.602056:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2783 00000100:00100000:2.0:1779690374.602075:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574272 00000100:00100000:2.0:1779690374.602078:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574272 00000100:00100000:2.0:1779690374.602105:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503573888 00000100:00100000:2.0:1779690374.602108:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503573888 00000100:00100000:2.0:1779690374.602128:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:2.0:1779690374.602134:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+27:2390:x1866137503574272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.602161:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+27:2390:x1866137503574272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.602167:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:2.0:1779690374.602178:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:2.0:1779690374.602184:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:2390:x1866137503573888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690374.602206:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:2390:x1866137503573888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690374.602212:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00080000:0.0:1779690374.605857:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690374.605865:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690374.605868:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690374.606770:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503573760 00000100:00100000:1.0:1779690374.606782:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503573760 00000100:00100000:1.0:1779690374.606853:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:1.0:1779690374.606864:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503573760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690374.606928:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503573760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (5432us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690374.606936:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:3.0:1779690375.210712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690375.212744:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574656 00000100:00100000:2.0:1779690375.213056:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574656 00000100:00100000:3.0:1779690375.214146:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 330 00000100:00100000:3.0:1779690375.214158:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:98948:x1866137503574656:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1779690375.214270:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:98948:x1866137503574656:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 114us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690375.214276:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 330 00000100:00100000:2.0:1779690375.219941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690375.222701:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503574912 00000100:00100000:1.0:1779690375.222715:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503574912 00000100:00100000:1.0:1779690375.224071:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:1.0:1779690375.224088:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+27:98948:x1866137503574912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690375.224567:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+28:98948:x1866137503574912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 485us (4634us total) trans 12884902060 rc 0/0 00000100:00100000:1.0:1779690375.224575:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00010000:00010000:2.0:1779690375.624975:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690376.650106:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690376.854247:0:62692:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 201: Register/Cancel restore ========== 02:26:15 (1779690375) 00000100:00100000:0.0:1779690377.078782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690377.078869:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575168 00000100:00100000:3.0:1779690377.078882:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575168 00000100:00080000:0.0:1779690377.079039:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690377.079050:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 331 00000100:00100000:3.0:1779690377.079065:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+28:99608:x1866137503575168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690377.079097:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690377.079124:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913df83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed90c expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079231:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079251:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079266:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079290:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079306:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079314:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079858:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913df98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079871:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913df98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.079881:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913df98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690377.079905:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1779690377.080093:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080103:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080110:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080116:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690377.080121:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080129:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080142:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:3.0:1779690377.080145:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690377.080150:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080157:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913df8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080169:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080175:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080191:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080197:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c4000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690377.080200:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080206:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080214:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f883cb600) 00010000:00010000:3.0:1779690377.080217:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690377.080220:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690377.080226:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913df91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.084721:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913df83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed90c expref: 31 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.084753:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913df98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed90c expref: 30 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.084764:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690377.084767:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690377.084772:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e000, rc 0) 00000100:00100000:2.0:1779690377.085358:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+30:99608:x1866137503575168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6293us (6584us total) trans 12884902061 rc 0/0 00000100:00100000:2.0:1779690377.085369:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 331 00000100:00100000:3.0:1779690377.090340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690377.090396:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575296 00000100:00100000:2.0:1779690377.090410:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575296 00000100:00100000:3.0:1779690377.090430:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690377.090488:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575424 00000100:00100000:0.0:1779690377.090493:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575424 00000100:00100000:2.0:1779690377.090516:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18645 00000100:00100000:0.0:1779690377.090531:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 332 00000100:00100000:2.0:1779690377.090537:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+31:2390:x1866137503575296:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1779690377.090538:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+31:99608:x1866137503575424:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00010000:00010000:2.0:1779690377.090558:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690377.090592:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913df98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed90c expref: 31 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690377.090691:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+31:99608:x1866137503575424:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 151us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690377.090699:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 332 00010000:00010000:2.0:1779690377.090775:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690377.090782:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690377.090825:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+29:2390:x1866137503575296:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 279us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690377.090833:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18645 00000100:00100000:0.0:1779690377.114497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690377.114585:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575552 00000100:00100000:2.0:1779690377.114598:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575552 00000100:00100000:2.0:1779690377.114736:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 333 00000100:00100000:2.0:1779690377.114760:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+27:99609:x1866137503575552:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690377.114787:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690377.114863:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913dfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed913 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.114953:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.114971:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.114996:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115152:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115174:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115188:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115445:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115453:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115460:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115476:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690377.115480:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115487:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115499:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:2.0:1779690377.115502:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690377.115506:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115512:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115524:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115530:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115535:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115539:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690377.115542:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115547:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115562:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc76c1c29 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690377.115565:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690377.115567:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115573:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115613:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913dfa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed913 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115623:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:2.0:1779690377.115626:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690377.115629:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913dfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed913 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.115638:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad800, rc 0) 00000100:00100000:2.0:1779690377.115717:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+27:99609:x1866137503575552:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 970us (1235us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690377.115727:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 333 00000100:00080000:0.0:1779690377.118089:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690377.126155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690377.126246:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575808 00000100:00100000:0.0:1779690377.126265:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575808 00000100:00100000:0.0:1779690377.126334:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 334 00000100:00100000:0.0:1779690377.126344:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:99609:x1866137503575808:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690377.126401:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690377.126426:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913df0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8e2 expref: 27 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.126446:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:0.0:1779690377.126451:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690377.126718:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.126732:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.126741:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.126772:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 28 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.126785:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 28 pid: 57559 timeout: 3204 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690377.126857:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb063480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492298880:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690377.126948:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3083f36240 going to sleep for 11 seconds 00000100:00100000:0.0:1779690377.130876:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb063480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492298880:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690377.130906:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690377.133376:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690377.134271:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503575936 00000100:00100000:0.0:1779690377.134285:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503575936 00010000:00010000:0.0:1779690377.134333:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 29 pid: 57559 timeout: 3204 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690377.134367:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3209 00000100:00100000:0.0:1779690377.134376:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+29:2392:x1866137503575936:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690377.134391:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690377.134397:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 29 pid: 57559 timeout: 3204 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134410:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 29 pid: 57559 timeout: 3204 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134430:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913de6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8b8 expref: 29 pid: 57559 timeout: 3204 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134449:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:0.0:1779690377.134454:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134476:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134483:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690377.134518:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690377.134587:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+28:2392:x1866137503575936:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 210us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690377.134595:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3209 00010000:00010000:2.0:1779690377.135757:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.135775:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.135867:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.135883:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.135895:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690377.137867:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x75:0x0]: returning size 512 00010000:00010000:2.0:1779690377.138311:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138325:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138334:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138341:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690377.138346:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138354:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138374:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:2.0:1779690377.138377:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690377.138382:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690377.138405:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913dfbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690377.138432:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ee6c7d16 reply state 00000000f74449f8 transno 12884902062 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690377.138442:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690377.138585:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:99609:x1866137503575808:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 12236us (12433us total) trans 12884902062 rc 0/0 00000100:00100000:2.0:1779690377.138594:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 334 00010000:00010000:1.0:1779690377.142465:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142488:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142522:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142529:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690377.142535:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142546:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142567:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc76c1c29 (ffff9e2f826ece00) 00010000:00010000:1.0:1779690377.142570:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690377.142577:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690377.142584:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dfc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690377.161759:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690377.161792:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492299008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690377.161977:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.162295:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492299264:0@lo:400:kworker.0 00000100:00100000:1.0:1779690377.162338:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492299136:0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162344:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.162374:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492299776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690377.162386:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.162408:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.162434:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690377.162440:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492299392:0@lo:400:kworker.0 00000100:00100000:1.0:1779690377.162445:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492299648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162471:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690377.162493:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299136 00000100:00100000:1.0:1779690377.162503:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299136 00000100:00100000:2.0:1779690377.162512:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299264 00000100:00100000:2.0:1779690377.162517:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299264 00000100:00100000:2.0:1779690377.162565:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299392 00000100:00100000:1.0:1779690377.162566:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1779690377.162570:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299392 00000100:00100000:1.0:1779690377.162580:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492299136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162596:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1779690377.162603:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492299264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162660:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492299264:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690377.162668:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1779690377.162702:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1779690377.162710:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492299392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690377.162756:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492299136:12345-0@lo:400:kworker.0 Request processed in 179us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690377.162762:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492299392:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690377.162768:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1779690377.162773:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1779690377.162839:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492299392:0@lo:400:kworker.0 00000100:00100000:1.0:1779690377.162847:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.162857:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492299264:0@lo:400:kworker.0 00000100:00100000:1.0:1779690377.162884:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492299136:0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162896:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299648 00000100:00100000:1.0:1779690377.162898:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690377.162901:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299648 00000100:00100000:1.0:1779690377.162906:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492299520:0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162923:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1779690377.162929:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.162961:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492299648:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690377.162967:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1779690377.163026:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299008 00000100:00100000:2.0:1779690377.163031:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299008 00000100:00100000:1.0:1779690377.163047:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690377.163065:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299776 00000100:00100000:1.0:1779690377.163076:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492299648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690377.163081:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299776 00000100:00100000:2.0:1779690377.163107:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1779690377.163114:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492299008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690377.163151:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690377.163189:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492299008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690377.165525:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1779690377.165560:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492299776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690377.165752:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492299520 00000100:00100000:3.0:1779690377.165764:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492299520 00000100:00100000:3.0:1779690377.165856:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:3.0:1779690377.165864:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492299520:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1779690377.166022:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690377.168004:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00080000:2.0:1779690377.169277:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690377.169291:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690377.169319:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690377.170061:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492299008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690377.171609:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492299520:12345-0@lo:400:kworker.0 Request processed in 5740us (8557us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690377.171626:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:2.0:1779690377.172017:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492299776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690377.172063:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492299776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5755us (8886us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690377.172076:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1779690377.172132:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492299520:0@lo:400:kworker.0 00010000:00010000:2.0:1779690377.674836:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690377.738103:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690377.738115:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690377.739575:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:3.0:1779690377.739593:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690378.556562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.556627:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576064 00000100:00100000:2.0:1779690378.556643:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576064 00000100:00100000:2.0:1779690378.556726:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 335 00000100:00100000:2.0:1779690378.556737:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:99644:x1866137503576064:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690378.556769:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690378.556798:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed91a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.556924:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.556942:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.556958:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690378.557098:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690378.557102:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 98 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690378.557128:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.557435:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed91a expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.557459:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed91a expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.557492:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690378.557495:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690378.557499:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:2.0:1779690378.557579:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:99644:x1866137503576064:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 844us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690378.557587:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 335 00000100:00100000:0.0:1779690378.559785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690378.560487:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.561516:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576448 00000100:00100000:2.0:1779690378.561529:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576448 00000100:00100000:2.0:1779690378.561759:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576192 00000100:00100000:2.0:1779690378.561763:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576192 00000100:00100000:0.0:1779690378.561776:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 336 00000100:00100000:0.0:1779690378.561791:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+29:99644:x1866137503576448:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:0.0:1779690378.561871:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690378.561898:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dfd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed91a expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690378.561908:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 337 00010000:00010000:0.0:1779690378.561920:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00000100:00100000:2.0:1779690378.561921:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+28:2390:x1866137503576192:12345-192.168.203.5@tcp:41:mkdir.0 00010000:00010000:0.0:1779690378.561933:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000024:2.0:1779690378.561952:0:57585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257977344 avail 2255880192 00000100:00100000:2.0:1779690378.562030:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+28:2390:x1866137503576192:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 111us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690378.562099:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+28:99644:x1866137503576448:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 312us (2319us total) trans 0 rc -17/-17 00000100:00100000:2.0:1779690378.562319:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 337 00000100:00100000:0.0:1779690378.562429:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 336 00000100:00100000:3.0:1779690378.569650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.570498:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576576 00000100:00100000:2.0:1779690378.570507:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576576 00000100:00100000:2.0:1779690378.570568:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 338 00000100:00100000:2.0:1779690378.570577:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+27:99644:x1866137503576576:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690378.570596:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690378.570617:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed921 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570678:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570704:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570715:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690378.570773:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690378.570777:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 98 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690378.570799:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570861:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed921 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570876:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed921 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.570884:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690378.570886:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690378.570890:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812aca00, rc 0) 00000100:00100000:2.0:1779690378.570949:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:99644:x1866137503576576:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 372us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690378.570957:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 338 00000100:00100000:3.0:1779690378.576040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.576112:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576704 00000100:00100000:2.0:1779690378.576121:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576704 00000100:00100000:2.0:1779690378.576184:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 339 00000100:00100000:2.0:1779690378.576195:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+28:99644:x1866137503576704:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690378.576213:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690378.576246:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed928 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576316:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576562:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576575:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576591:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576607:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576613:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576711:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576720:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576726:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690378.576763:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x75:0x0]: returning size 512 00000004:00200000:2.0:1779690378.576766:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690378.576786:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576835:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576842:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576848:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576854:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ac600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690378.576858:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576865:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576877:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690378.576879:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690378.576884:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576890:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913dfec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576901:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576908:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576913:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576925:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690378.576928:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576934:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576941:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc76c1c29 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690378.576943:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690378.576946:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576951:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913dff3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.576987:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913dfe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed928 expref: 30 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.577000:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed928 expref: 29 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.577008:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690378.577010:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690378.577013:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad200, rc 0) 00000100:00100000:2.0:1779690378.577075:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:99644:x1866137503576704:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 882us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690378.577082:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 339 00000100:00100000:0.0:1779690378.621529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690378.621633:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503576832 00000100:00100000:1.0:1779690378.621643:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503576832 00000100:00100000:1.0:1779690378.621702:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 340 00000100:00100000:1.0:1779690378.621712:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:99650:x1866137503576832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690378.621731:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690378.621752:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed92f expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.621840:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.621868:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.621878:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690378.621933:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:1.0:1779690378.621937:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 98 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690378.621959:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.621993:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 30 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.622012:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 29 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.622019:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690378.622022:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690378.622026:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690378.622084:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+29:99650:x1866137503576832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 374us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690378.622091:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 340 00000100:00100000:3.0:1779690378.629213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.629310:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503577088 00000100:00100000:2.0:1779690378.629333:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503577088 00000100:00100000:2.0:1779690378.629399:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 341 00000100:00100000:2.0:1779690378.629410:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:99650:x1866137503577088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690378.629430:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690378.629433:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690378.629458:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913dffa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed928 expref: 29 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629477:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690378.629488:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690378.629501:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e00f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed936 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629634:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629647:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629657:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629669:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629676:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.629682:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630325:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630335:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630343:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690378.630352:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 0 00010000:00010000:2.0:1779690378.630376:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630383:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630390:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630396:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690378.630401:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630408:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630416:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690378.630419:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690378.630423:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630438:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e016 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690378.630449:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000061c06e0c reply state 0000000056bb3b99 transno 12884902063 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690378.630457:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690378.630486:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e00f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630504:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 30 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.630511:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:2.0:1779690378.630513:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690378.630516:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad800, rc 0) 00000100:00100000:2.0:1779690378.630587:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:99650:x1866137503577088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1178us (1382us total) trans 12884902063 rc 0/0 00000100:00100000:2.0:1779690378.630596:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 341 00000100:00100000:0.0:1779690378.635201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:1.0:1779690378.635409:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635425:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635457:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635465:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ac600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690378.635471:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635480:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635502:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x48e8e83d (ffff9e2f826ec100) 00010000:00010000:1.0:1779690378.635505:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690378.635511:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.635518:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e01d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690378.635743:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503577344 00000100:00100000:3.0:1779690378.635756:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503577344 00000100:00100000:3.0:1779690378.635857:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 342 00000100:00100000:3.0:1779690378.635872:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+30:99650:x1866137503577344:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690378.635907:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690378.635932:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e032 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed93d expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.636074:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.636089:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.636099:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.636140:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.636155:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 31 pid: 57585 timeout: 3206 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690378.636187:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091750e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492299904:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690378.636360:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8face000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690378.640769:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091750e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492299904:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690378.640833:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690378.641332:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690378.641671:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503577472 00000100:00100000:3.0:1779690378.641680:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503577472 00010000:00010000:3.0:1779690378.641745:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 32 pid: 57585 timeout: 3206 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690378.641791:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3210 00000100:00100000:3.0:1779690378.641831:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+32:2392:x1866137503577472:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690378.641852:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690378.641860:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 32 pid: 57585 timeout: 3206 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.641876:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 32 pid: 57585 timeout: 3206 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.641905:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e024 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed936 expref: 32 pid: 57585 timeout: 3206 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.641925:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:3.0:1779690378.641931:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.641957:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.641975:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.642011:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690378.642094:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:2392:x1866137503577472:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 292us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690378.642103:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3210 00010000:00010000:0.0:1779690378.642362:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.642371:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690378.642396:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 0 00010000:00010000:0.0:1779690378.642792:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.642801:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645095:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645103:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690378.645109:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645119:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645143:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:0.0:1779690378.645147:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690378.645152:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645159:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e039 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645287:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e032 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed93d expref: 31 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645300:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:0.0:1779690378.645303:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690378.645307:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e032 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed93d expref: 31 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690378.645322:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00100000:0.0:1779690378.645425:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+30:99650:x1866137503577344:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 9547us (10229us total) trans 12884902064 rc 301/301 00000100:00100000:0.0:1779690378.645436:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 342 00000100:00100000:0.0:1779690378.649413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.649559:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503577728 00000100:00100000:2.0:1779690378.649573:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503577728 00000100:00100000:2.0:1779690378.649678:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1779690378.649691:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+30:99650:x1866137503577728:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690378.650217:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+31:99650:x1866137503577728:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 527us (817us total) trans 12884902065 rc 0/0 00000100:00100000:2.0:1779690378.650226:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:1.0:1779690378.653592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690378.653848:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503577856 00000100:00100000:2.0:1779690378.653861:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503577856 00000100:00100000:2.0:1779690378.653928:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 343 00000100:00100000:2.0:1779690378.653941:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:99650:x1866137503577856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690378.653982:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690378.654009:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e047 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed944 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.654094:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e047 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed944 expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.654115:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e047 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed944 expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690378.654137:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690378.654140:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690378.654145:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad000, rc 0) 00000100:00100000:2.0:1779690378.654452:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+32:99650:x1866137503577856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 513us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690378.654461:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 343 00000100:00100000:2.0:1779690378.657575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690378.657650:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503578112 00000100:00100000:1.0:1779690378.657661:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503578112 00000100:00100000:1.0:1779690378.657726:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 344 00000100:00100000:1.0:1779690378.657736:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+32:99650:x1866137503578112:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1779690378.657835:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.657856:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.657869:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658189:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658198:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658205:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658212:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690378.658216:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658225:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658238:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:1.0:1779690378.658241:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690378.658246:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.658252:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e04e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690378.658346:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+33:99650:x1866137503578112:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 609us (779us total) trans 12884902066 rc 0/0 00000100:00100000:1.0:1779690378.658354:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 344 00000100:00100000:0.0:1779690378.660753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690378.660893:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503578368 00000100:00100000:1.0:1779690378.660905:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503578368 00000100:00100000:1.0:1779690378.660990:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 345 00000100:00100000:1.0:1779690378.661021:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+33:99650:x1866137503578368:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690378.662103:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.662131:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.662147:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690378.662267:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902067 00000004:00010000:1.0:1779690378.662345:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1bcfe48 reply state 00000000226c508e transno 12884902068 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690378.662356:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690378.662781:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+36:99650:x1866137503578368:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1759us (2035us total) trans 12884902068 rc 0/0 00000100:00100000:1.0:1779690378.662791:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 345 00000020:00080000:1.0:1779690378.662798:0:57560:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690378.664964:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.664994:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.665002:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.665008:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690378.665015:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.665023:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.665043:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:3.0:1779690378.665047:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690378.665053:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.665096:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e055 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690378.666708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690378.666838:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503578624 00000100:00100000:1.0:1779690378.666851:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503578624 00000100:00100000:1.0:1779690378.666916:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1779690378.666927:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:99650:x1866137503578624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690378.667247:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+36:99650:x1866137503578624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 321us (549us total) trans 12884902069 rc 0/0 00000100:00100000:1.0:1779690378.667266:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00010000:00010000:2.0:1779690378.696920:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690378.698258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690378.698436:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503578752 00000100:00100000:1.0:1779690378.698450:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503578752 00000100:00100000:1.0:1779690378.698562:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 346 00000100:00100000:1.0:1779690378.698593:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+36:99652:x1866137503578752:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690378.698627:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690378.698651:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed94b expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698752:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698772:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698785:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698838:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698847:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.698854:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699008:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e071 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699017:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699025:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690378.699200:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x75:0x0]: returning size 512 00000004:00200000:1.0:1779690378.699205:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690378.699239:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699254:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699262:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699270:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699276:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690378.699281:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699290:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699314:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690378.699380:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690378.699387:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699394:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699414:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699433:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699439:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699444:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690378.699448:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699454:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699463:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc76c1c29 (ffff9e2f903c9500) 00010000:00010000:1.0:1779690378.699465:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690378.699468:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699474:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e06a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699515:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed94b expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699530:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9e00/0xb4bb873a1913e071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed94b expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690378.699537:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:1.0:1779690378.699539:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690378.699548:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9e00, rc 0) 00000100:00100000:1.0:1779690378.700037:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+37:99652:x1866137503578752:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1444us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690378.700048:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 346 00000100:00100000:0.0:1779690378.704107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690378.704214:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503578880 00000100:00100000:3.0:1779690378.704228:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503578880 00000100:00100000:3.0:1779690378.704309:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 347 00000100:00100000:3.0:1779690378.704329:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+37:99652:x1866137503578880:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690378.704357:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690378.704384:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e078 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed952 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704477:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704494:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704507:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704527:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704534:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704540:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704662:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704683:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704691:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690378.704737:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 40894464 00000004:00200000:3.0:1779690378.704742:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690378.704765:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704776:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704785:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704792:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704798:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704860:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690378.704864:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704873:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704886:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:3.0:1779690378.704895:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690378.704901:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704908:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e07f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704925:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704931:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704937:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704941:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690378.704944:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704949:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704956:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x48e8e83d (ffff9e2f883cb000) 00010000:00010000:3.0:1779690378.704959:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690378.704961:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.704978:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e086 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.705013:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e078 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed952 expref: 39 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.705035:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed952 expref: 38 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690378.705043:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:3.0:1779690378.705046:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690378.705048:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f000, rc 0) 00000100:00100000:3.0:1779690378.705122:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+38:99652:x1866137503578880:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 804us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690378.705131:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 347 00000100:00100000:2.0:1779690379.079908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690379.080045:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579008 00000100:00100000:3.0:1779690379.080059:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579008 00000100:00100000:3.0:1779690379.080176:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18646 00000100:00100000:3.0:1779690379.080392:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+22:2392:x1866137503579008:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690379.080466:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 13 locks, starting at 0 00010000:00010000:3.0:1779690379.080516:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023ff83c9/0xb4bb873a1913de10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed89c expref: 22 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.080546:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1ba:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080554:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a13228c3/0xb4bb873a1913afda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec16c expref: 21 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.080574:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b9:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080580:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d67734a/0xb4bb873a1913aea6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec0fc expref: 20 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.080624:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b8:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080635:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08e0639/0xb4bb873a1913ad33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec046 expref: 19 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690379.080643:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1779690379.080653:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b7:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080662:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f264d855/0xb4bb873a1913abea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebf9e expref: 18 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.080679:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080685:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085782464/0xb4bb873a1913aaa1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebf27 expref: 17 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.080701:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.080707:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a4cf32/0xb4bb873a1913a92e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebe40 expref: 16 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.081196:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.081209:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e240b5e/0xb4bb873a1913a7fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebdd0 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.081228:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.081234:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8d0483/0xb4bb873a1913a6b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebd59 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.081250:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.081265:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004218d274/0xb4bb873a1913a53e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebc72 expref: 13 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690379.081282:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1b1:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690379.081287:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008faa68c2/0xb4bb873a1913a40a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebc02 expref: 12 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690379.081307:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eca0fa3/0xb4bb873a19132c00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750be86a2 expref: 11 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690379.081329:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8ca8a8d/0xb4bb873a191313aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750be7efa expref: 10 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690379.081341:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690379.081416:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503579008:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1105us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690379.081425:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18646 00000001:00080000:0.0:1779690379.275267:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902064 is committed 00000001:00080000:0.0:1779690379.275298:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902069 is committed 00000001:00080000:0.0:1779690379.275318:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902060 is committed 00000001:00080000:0.0:1779690379.275335:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902061 is committed 00000100:00100000:2.0:1779690379.716297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690379.716360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690379.716367:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579136 00000100:00100000:3.0:1779690379.716377:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579136 00000100:00100000:2.0:1779690379.716386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690379.716427:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690379.716452:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579392 00000100:00100000:2.0:1779690379.716456:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579392 00000100:00100000:3.0:1779690379.716486:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:2.0:1779690379.716494:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579648 00000100:00100000:3.0:1779690379.716497:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503579136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690379.716497:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579648 00000100:00100000:2.0:1779690379.716522:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2785 00000100:00100000:2.0:1779690379.716539:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503579392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690379.716577:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503579392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690379.716585:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2785 00000100:00100000:2.0:1779690379.716605:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2786 00000100:00100000:2.0:1779690379.716611:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503579648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1779690379.716865:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690379.716878:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579264 00000100:00100000:1.0:1779690379.716882:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579264 00000100:00100000:1.0:1779690379.716927:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:1.0:1779690379.716937:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:2389:x1866137503579264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690379.716943:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503579136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 446us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690379.716943:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503579648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 328us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690379.716952:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:2.0:1779690379.716952:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2786 00000100:00100000:1.0:1779690379.716985:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:2389:x1866137503579264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690379.716992:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00080000:1.0:1779690379.717013:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690379.718055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690379.718480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690379.718513:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579520 00000100:00100000:0.0:1779690379.718520:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579520 00000100:00100000:0.0:1779690379.718571:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:0.0:1779690379.718580:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+30:2389:x1866137503579520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690379.718639:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+30:2389:x1866137503579520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690379.718647:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00080000:0.0:1779690379.718675:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690379.718719:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579776 00000100:00100000:1.0:1779690379.718724:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579776 00000100:00100000:1.0:1779690379.718759:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2787 00000100:00100000:1.0:1779690379.718766:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503579776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690379.718799:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503579776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690379.718830:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2787 00000100:00080000:0.0:1779690379.718982:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690379.721186:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690380.262497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690380.267694:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503579904 00000100:00100000:3.0:1779690380.267709:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503579904 00000100:00100000:3.0:1779690380.267779:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 348 00000100:00100000:3.0:1779690380.267790:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+30:99673:x1866137503579904:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690380.267838:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690380.267859:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed959 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.267932:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.267946:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.267966:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690380.268165:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x75:0x0]: returning size 7680 00000004:00200000:3.0:1779690380.268169:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690380.268249:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.268277:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 32 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.268292:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 31 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.268301:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:3.0:1779690380.268305:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690380.268314:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00100000:3.0:1779690380.268375:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:99673:x1866137503579904:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 586us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690380.268382:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 348 00000100:00100000:0.0:1779690380.273178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690380.273225:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580160 00000100:00100000:2.0:1779690380.273234:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580160 00000100:00100000:2.0:1779690380.273294:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18647 00000100:00100000:2.0:1779690380.273304:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:99673:x1866137503580160:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1779690380.273320:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1779690380.273346:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e08d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed952 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690380.273364:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e047 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed944 expref: 30 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690380.273392:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690380.273717:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690380.273764:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:99673:x1866137503580160:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 462us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690380.273770:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18647 00000100:00100000:3.0:1779690380.275636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690380.275708:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580288 00000100:00100000:1.0:1779690380.275716:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580288 00000100:00100000:1.0:1779690380.275767:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 349 00000100:00100000:1.0:1779690380.275776:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:99673:x1866137503580288:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:1.0:1779690380.275901:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690380.275946:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690380.275967:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1779690380.276428:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].15, 136 off10232 00000100:00100000:1.0:1779690380.276508:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:99673:x1866137503580288:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 731us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690380.276516:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 349 00010000:00010000:3.0:1779690380.745330:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690380.910707:0:62839:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690380.910715:0:62839:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690380.910780:0:62839:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 16 count 12 00000040:00080000:3.0:1779690380.910785:0:62839:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690380.965303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690380.965400:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580416 00000100:00100000:3.0:1779690380.965410:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580416 00000100:00100000:3.0:1779690380.965466:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 350 00000100:00100000:3.0:1779690380.965476:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+29:99683:x1866137503580416:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690380.965496:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690380.965514:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e0a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed960 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965576:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965589:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965600:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965615:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965634:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.965642:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966173:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966184:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966191:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690380.966226:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 40894464 00000004:00200000:3.0:1779690380.966230:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690380.966248:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966259:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966267:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966273:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966279:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966304:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690380.966309:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966316:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966328:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:3.0:1779690380.966331:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690380.966335:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966341:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e0b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966353:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966358:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966364:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966369:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690380.966371:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966377:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966395:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x48e8e83d (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690380.966398:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690380.966400:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966406:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e0b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x48e8e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966435:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e0a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 31 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966448:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 30 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690380.966456:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690380.966458:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690380.966461:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f000, rc 0) 00000100:00100000:3.0:1779690380.966528:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+30:99683:x1866137503580416:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1053us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690380.966537:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 350 00000100:00100000:1.0:1779690380.985111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690380.985178:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580672 00000100:00100000:2.0:1779690380.985187:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580672 00000100:00100000:2.0:1779690380.985246:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 351 00000100:00100000:2.0:1779690380.985256:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+30:99683:x1866137503580672:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690380.985389:0:57585:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690380.985393:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690380.985422:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 16 count 12 00000040:00080000:2.0:1779690380.985427:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690380.985677:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].16, 136 off10368 00000100:00100000:2.0:1779690380.985764:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+30:99683:x1866137503580672:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 509us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690380.985772:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 351 00010000:00010000:2.0:1779690381.768929:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690382.281530:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492300032:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.281628:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690382.281699:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300544:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.281731:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690382.281761:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1779690382.281766:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.281793:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690382.281990:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492300160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.282020:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690382.282231:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300160 00000100:00100000:2.0:1779690382.282241:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300160 00000100:00100000:2.0:1779690382.282302:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1779690382.282312:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492300160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690382.282366:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492300160:12345-0@lo:400:kworker.0 Request processed in 56us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.282374:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1779690382.282415:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690382.283029:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690382.283112:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690382.283157:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690382.283196:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300928 00000100:00100000:3.0:1779690382.283201:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300928 00000100:00100000:0.0:1779690382.284153:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492300160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284166:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492300672:0@lo:400:kworker.0 00000100:00100000:3.0:1779690382.284179:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1779690382.284189:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690382.284208:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1779690382.284254:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690382.284254:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1779690382.284261:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492300288:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284284:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690382.284298:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690382.284300:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492300800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690382.284306:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1779690382.284321:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690382.284363:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300032 00000100:00100000:0.0:1779690382.284369:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300032 00000100:00100000:0.0:1779690382.284403:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1779690382.284404:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300672 00000100:00100000:2.0:1779690382.284408:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300672 00000100:00100000:0.0:1779690382.284418:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492300032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690382.284436:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300288 00000100:00100000:2.0:1779690382.284439:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300288 00000100:00100000:0.0:1779690382.284453:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492300032:12345-0@lo:400:kworker.0 Request processed in 37us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690382.284461:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1779690382.284462:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1779690382.284468:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492300672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284496:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300544 00000100:00100000:0.0:1779690382.284500:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300544 00000100:00100000:2.0:1779690382.284509:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492300672:12345-0@lo:400:kworker.0 Request processed in 41us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.284515:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1779690382.284523:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300416 00000100:00100000:0.0:1779690382.284526:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300416 00000100:00100000:2.0:1779690382.284528:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1779690382.284532:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492300288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690382.284560:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492300288:12345-0@lo:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.284566:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1779690382.284602:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492300288:0@lo:400:kworker.0 00000100:00100000:2.0:1779690382.284612:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492300672:0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284623:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1779690382.284630:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284663:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300544:12345-0@lo:400:kworker.0 Request processed in 34us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690382.284670:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1779690382.284682:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1779690382.284688:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690382.284713:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492300416:12345-0@lo:400:kworker.0 Request processed in 26us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690382.284719:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:3.0:1779690382.285519:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492300800 00000100:00100000:3.0:1779690382.285526:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492300800 00000100:00100000:3.0:1779690382.285561:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1779690382.285569:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492300800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690382.285601:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690382.285662:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492300800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690382.285669:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1779690382.285733:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492300800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1779690382.285779:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690382.285785:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690382.285788:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690382.285839:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690382.285852:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300416:0@lo:400:kworker.0 00000100:00100000:3.0:1779690382.285865:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492300032:0@lo:400:kworker.0 00000100:00100000:3.0:1779690382.285875:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492300544:0@lo:400:kworker.0 00010000:00010000:2.0:1779690382.797760:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690382.858063:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690382.858074:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690382.858521:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 17 count 12 00000040:00080000:1.0:1779690382.858529:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690382.858739:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492301056:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690382.859202:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8b8450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690382.864650:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.864737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.865557:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580800 00000100:00100000:1.0:1779690382.865571:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580800 00000100:00100000:1.0:1779690382.865649:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503580928 00000100:00100000:1.0:1779690382.865652:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503580928 00000100:00100000:1.0:1779690382.865683:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 352 00000100:00100000:1.0:1779690382.865695:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+29:99713:x1866137503580800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690382.865736:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x77:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690382.866500:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+29:99713:x1866137503580800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 802us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690382.866519:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 352 00000100:00100000:2.0:1779690382.866555:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 353 00000100:00100000:3.0:1779690382.866639:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492301056:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1779690382.866864:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690382.867713:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:99714:x1866137503580928:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690382.867755:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x77:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690382.867910:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+27:99714:x1866137503580928:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 1339us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.867920:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 353 00000100:00100000:1.0:1779690382.873213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.873541:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503581056 00000100:00100000:2.0:1779690382.873553:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503581056 00000100:00100000:2.0:1779690382.873641:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 354 00000100:00100000:2.0:1779690382.873652:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:99713:x1866137503581056:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.873760:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873782:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873796:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873857:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873866:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873874:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873912:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873921:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.873939:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690382.873984:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 40894464 00000004:00200000:2.0:1779690382.873989:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690382.874003:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874024:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874031:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874038:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874044:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.874049:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874057:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874070:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690382.874073:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690382.874078:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874084:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874097:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874103:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874108:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874121:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ac600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.874124:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874129:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874137:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x822f946e (ffff9e2f826ec500) 00010000:00010000:2.0:1779690382.874139:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690382.874141:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874147:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x822f946e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874163:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874169:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874173:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874177:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.874180:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874184:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874200:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690382.874202:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690382.874206:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.874211:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690382.874884:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+27:99713:x1866137503581056:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 1228us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.874896:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 354 00000100:00100000:3.0:1779690382.881019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.881125:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503581312 00000100:00100000:1.0:1779690382.881138:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503581312 00000100:00100000:1.0:1779690382.881209:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 355 00000100:00100000:1.0:1779690382.881221:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+27:99713:x1866137503581312:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690382.881247:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690382.881271:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e0da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed967 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881394:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881413:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881427:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690382.881441:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x77:0x0]: returning size 40894464 00010000:00010000:1.0:1779690382.881611:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881620:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881628:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881646:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690382.881651:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881660:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881673:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690382.881677:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690382.881682:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881689:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e0e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881736:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e0da lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed967 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881747:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690382.881750:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690382.881754:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e0da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed967 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.881765:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8600, rc 0) 00000100:00100000:1.0:1779690382.881865:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+28:99713:x1866137503581312:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 645us (858us total) trans 12884902070 rc 301/301 00000100:00100000:1.0:1779690382.881874:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 355 00000100:00100000:1.0:1779690382.888248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690382.889745:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503581440 00000100:00100000:3.0:1779690382.889762:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503581440 00000100:00100000:3.0:1779690382.889878:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 356 00000100:00100000:3.0:1779690382.889890:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+28:99713:x1866137503581440:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690382.889964:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x77:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690382.890117:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+28:99713:x1866137503581440:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 229us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690382.890137:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 356 00000100:00100000:0.0:1779690382.893771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.893954:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503581568 00000100:00100000:2.0:1779690382.893967:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503581568 00000100:00100000:2.0:1779690382.894042:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 357 00000100:00100000:2.0:1779690382.894054:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+28:99713:x1866137503581568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.894081:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690382.894108:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed96e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894182:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894200:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894212:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894228:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894260:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894268:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894901:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e104 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894913:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.894932:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690382.895027:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x75:0x0]: returning size 7680 00000004:00200000:2.0:1779690382.895032:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690382.895113:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895127:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895134:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895141:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895148:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ac600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.895152:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895167:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895181:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690382.895184:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690382.895190:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895196:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895209:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895216:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895222:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895227:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.895230:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895365:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895376:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc76c1c29 (ffff9e2f826ec500) 00010000:00010000:2.0:1779690382.895379:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690382.895382:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895399:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e0fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc76c1c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895602:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e0ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed96e expref: 30 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895618:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad800/0xb4bb873a1913e104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed96e expref: 29 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.895626:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:2.0:1779690382.895628:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690382.895631:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad800, rc 0) 00000100:00100000:2.0:1779690382.895771:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+29:99713:x1866137503581568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1718us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.895781:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 357 00000100:00100000:3.0:1779690382.900053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.900402:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503581824 00000100:00100000:1.0:1779690382.900417:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503581824 00000100:00100000:1.0:1779690382.900543:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 358 00000100:00100000:1.0:1779690382.900555:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+29:99713:x1866137503581824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690382.900592:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690382.900617:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e10b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed975 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690382.901637:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e8:0x0], index 0: 0 00010000:00010000:1.0:1779690382.901970:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e112 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.901988:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.902002:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.902074:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e10b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed975 expref: 32 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.902095:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed975 expref: 31 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.902105:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:1.0:1779690382.902108:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690382.902111:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9000, rc 0) 00000100:00100000:1.0:1779690382.902189:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+31:99713:x1866137503581824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1636us (2150us total) trans 12884902071 rc 0/0 00000100:00100000:1.0:1779690382.902209:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 358 00000100:00100000:0.0:1779690382.908719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.908827:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582080 00000100:00100000:1.0:1779690382.908840:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582080 00000100:00100000:1.0:1779690382.908981:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 359 00000100:00100000:1.0:1779690382.908995:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+31:99713:x1866137503582080:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690382.909076:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690382.909108:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e112 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed975 expref: 31 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.909144:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:1.0:1779690382.909159:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690382.909187:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.909203:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.909222:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.909264:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690382.909280:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 29 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690382.909296:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492301184:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690382.909448:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690382.917749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.918005:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492301184:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690382.918044:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690382.918417:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582208 00000100:00100000:3.0:1779690382.918428:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582208 00010000:00010000:3.0:1779690382.918497:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 30 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690382.918552:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3211 00000100:00100000:3.0:1779690382.918563:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+30:2392:x1866137503582208:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690382.918582:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690382.918590:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 30 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918603:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 30 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918634:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e09b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x75:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed959 expref: 30 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918655:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:3.0:1779690382.918661:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918700:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918709:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.918736:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1779690382.918740:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690382.918904:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.918913:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690382.918950:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+29:2392:x1866137503582208:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 387us (1212us total) trans 0 rc 0/0 00010000:00010000:0.0:1779690382.918952:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690382.918959:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3211 00010000:00010000:0.0:1779690382.918974:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.918984:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919320:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919331:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919338:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919345:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690382.919350:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919358:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919368:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x0 (ffff9e2f903c9c00) 00010000:00010000:0.0:1779690382.919371:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690382.919375:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919380:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e120 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x75:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919392:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919405:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919412:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919417:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690382.919420:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919427:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919435:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x75:0x0].0x3c814a50 (ffff9e308bf54200) 00010000:00010000:0.0:1779690382.919437:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690382.919440:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.919445:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e127 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x75:0x0].0x3c814a50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690382.922144:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+30:99713:x1866137503582080:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 13135us (13430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1779690382.922161:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 359 00000100:00100000:0.0:1779690382.933988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.934097:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582336 00000100:00100000:2.0:1779690382.934110:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582336 00000100:00100000:2.0:1779690382.934176:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 360 00000100:00100000:2.0:1779690382.934186:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+30:99713:x1866137503582336:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.934212:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690382.934239:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e12e lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed97c expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934280:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e135 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934296:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934325:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934443:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e12e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed97c expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934464:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad000/0xb4bb873a1913e135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed97c expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.934474:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f826ec500) 00010000:00010000:2.0:1779690382.934478:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690382.934481:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad000, rc 0) 00000100:00100000:2.0:1779690382.934554:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+31:99713:x1866137503582336:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 370us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.934561:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 360 00000100:00100000:1.0:1779690382.941353:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.943022:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582592 00000100:00100000:2.0:1779690382.943040:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582592 00000100:00100000:2.0:1779690382.943127:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 361 00000100:00100000:2.0:1779690382.943140:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+31:99713:x1866137503582592:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.943254:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.943277:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.943291:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690382.944041:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].5, 88 off8560 00000004:00080000:2.0:1779690382.944058:0:57559:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3110518251123ns, next at 3111518248048ns, rc = 0 00000004:00010000:2.0:1779690382.944171:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b32733c6 reply state 00000000d2cdb634 transno 12884902072 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690382.944184:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690382.944335:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+33:99713:x1866137503582592:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1193us (2990us total) trans 12884902072 rc 0/0 00000100:00100000:2.0:1779690382.944344:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 361 00010000:00010000:2.0:1779690382.949913:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.949945:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.949955:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.949963:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.949968:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.949976:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.949997:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f826ec500) 00010000:00010000:2.0:1779690382.950001:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1779690382.950006:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.950037:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e13c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690382.951283:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.951403:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582720 00000100:00100000:2.0:1779690382.951416:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582720 00000100:00100000:2.0:1779690382.951480:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 362 00000100:00100000:2.0:1779690382.951490:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:99713:x1866137503582720:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.951523:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690382.951544:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e143 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed983 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.951629:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed983 expref: 33 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.951643:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac600/0xb4bb873a1913e143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed983 expref: 33 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.951676:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f826ec500) 00010000:00010000:2.0:1779690382.951680:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690382.951684:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ac600, rc 0) 00000100:00100000:2.0:1779690382.951755:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+33:99713:x1866137503582720:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 265us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690382.951762:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 362 00000100:00100000:1.0:1779690382.956861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.957425:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503582848 00000100:00100000:2.0:1779690382.957440:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503582848 00000100:00080000:3.0:1779690382.957509:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690382.957532:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6376 00000100:00100000:2.0:1779690382.957544:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503582848:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1779690382.958023:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+22:2391:x1866137503582848:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 471us (1207us total) trans 4294968337 rc 0/0 00000100:00100000:2.0:1779690382.958033:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6376 00000100:00100000:0.0:1779690382.966324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690382.966920:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503583104 00000100:00100000:1.0:1779690382.966945:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503583104 00000100:00100000:1.0:1779690382.967037:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:1.0:1779690382.967050:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+33:99713:x1866137503583104:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690382.967538:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+34:99713:x1866137503583104:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 489us (1225us total) trans 12884902073 rc 0/0 00000100:00100000:1.0:1779690382.967545:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:1.0:1779690382.970861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690382.971577:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503583360 00000100:00100000:0.0:1779690382.971591:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503583360 00000100:00100000:0.0:1779690382.971664:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 363 00000100:00100000:0.0:1779690382.971692:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+34:99713:x1866137503583360:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690382.971855:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+34:99713:x1866137503583360:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 166us (1006us total) trans 0 rc -125/-125 00000100:00100000:0.0:1779690382.971864:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 363 00000100:00100000:0.0:1779690382.982549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.983836:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503583616 00000100:00100000:2.0:1779690382.983848:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503583616 00000100:00100000:2.0:1779690382.984434:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:2.0:1779690382.984446:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+34:99713:x1866137503583616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1779690382.989634:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1779690382.991013:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].6, 64 off8624 00000001:00080000:2.0:1779690382.991031:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902074 00010000:00010000:2.0:1779690382.991101:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991118:0:57563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991129:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991139:0:57563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991146:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991152:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.991175:0:57563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690382.991597:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+36:99713:x1866137503583616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 7151us (9055us total) trans 12884902075 rc 0/0 00000100:00100000:2.0:1779690382.991617:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000020:00080000:2.0:1779690382.991623:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690382.991783:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690382.991797:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.993207:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690382.993214:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.993226:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.993246:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x11:0x0].0x0 (ffff9e2f826ec500) 00010000:00010000:3.0:1779690382.993250:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690382.993257:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.993264:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e14a lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.993299:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690382.993302:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690382.993305:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690382.995657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690382.995794:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503583872 00000100:00100000:2.0:1779690382.995818:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503583872 00000100:00100000:2.0:1779690382.995870:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 364 00000100:00100000:2.0:1779690382.995887:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:99713:x1866137503583872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690382.995974:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.995992:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996003:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996033:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996040:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996046:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996052:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690382.996055:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996062:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996088:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690382.996091:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690382.996095:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996101:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8800/0xb4bb873a1913e0a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996119:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996129:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996137:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996166:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690382.996179:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 28 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690382.996193:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492301312:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690382.996291:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8d540540 going to sleep for 11 seconds 00000100:00100000:1.0:1779690382.999011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690382.999095:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492301312:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690382.999115:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584000 00000100:00100000:0.0:1779690382.999125:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584000 00010000:00010000:3.0:1779690382.999133:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999177:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 29 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690382.999218:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3212 00000100:00100000:0.0:1779690382.999228:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+29:2391:x1866137503584000:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690382.999241:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690382.999249:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 29 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999262:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 29 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999284:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e0be lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x77:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed960 expref: 29 pid: 57561 timeout: 3210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999299:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690382.999304:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999314:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999331:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999505:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690382.999506:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690382.999518:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999535:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999542:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999551:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999559:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690382.999567:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690382.999567:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+28:2391:x1866137503584000:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 335us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690382.999596:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3212 00010000:00010000:3.0:1779690382.999774:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999795:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690382.999849:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690382.999855:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999864:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e158 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x77:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999882:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999889:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999895:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999901:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690382.999904:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999911:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999932:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x77:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690382.999935:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690382.999938:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690382.999945:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e151 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x77:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690383.001362:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:99713:x1866137503583872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 5468us (5704us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690383.001449:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 364 00000040:00080000:1.0:1779690383.002060:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690383.002068:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690383.002541:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:1.0:1779690383.002552:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690383.365054:0:62987:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690383.365062:0:62987:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690383.365137:0:62987:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 17 count 12 00000040:00080000:0.0:1779690383.365142:0:62987:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690383.817445:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690383.951837:0:63039:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690383.951844:0:63039:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690383.951924:0:63039:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 17 count 12 00000040:00080000:0.0:1779690383.951930:0:63039:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:00080000:1.0:1779690384.387080:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968337 is committed 00000001:00080000:2.0:1779690384.390077:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902073 is committed 00000001:00080000:2.0:1779690384.390103:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902075 is committed 00000004:00080000:2.0:1779690384.390111:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1779690384.390443:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492301440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1779690384.390510:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690384.390581:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492301440 00000100:00100000:1.0:1779690384.390596:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492301440 00000100:00100000:1.0:1779690384.390651:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6377 00000100:00100000:1.0:1779690384.390660:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492301440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1779690384.391002:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492301440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 342us (490us total) trans 4294968338 rc 0/0 00000100:00100000:1.0:1779690384.391009:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6377 00000100:00080000:1.0:1779690384.391028:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1779690384.391062:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f8f153100/2, rc 0, transno 4294968338 00000100:00100000:1.0:1779690384.391072:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492301440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1779690384.837457:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837488:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690384.837603:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584128 00000100:00100000:1.0:1779690384.837612:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584128 00000100:00100000:1.0:1779690384.837654:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:1.0:1779690384.837663:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503584128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.837732:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503584128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690384.837740:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:1.0:1779690384.837773:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584384 00000100:00100000:1.0:1779690384.837776:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584384 00000100:00100000:1.0:1779690384.837825:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584896 00000100:00100000:1.0:1779690384.837828:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584896 00000100:00100000:1.0:1779690384.837857:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584512 00000100:00100000:1.0:1779690384.837860:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584512 00000100:00100000:1.0:1779690384.837877:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584768 00000100:00100000:1.0:1779690384.837879:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584768 00000100:00100000:1.0:1779690384.837896:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2790 00000100:00100000:1.0:1779690384.837911:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503584384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.837941:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+21:2389:x1866137503584384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690384.837947:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2790 00000100:00100000:1.0:1779690384.837959:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2791 00000100:00100000:1.0:1779690384.837965:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503584896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.837988:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503584896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690384.837994:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2791 00000100:00100000:1.0:1779690384.838005:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2792 00000100:00100000:1.0:1779690384.838011:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503584512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.838032:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503584512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690384.838037:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2792 00000100:00100000:1.0:1779690384.838047:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2793 00000100:00100000:1.0:1779690384.838053:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503584768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.838074:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503584768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690384.838080:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2793 00000100:00100000:1.0:1779690384.838101:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584640 00000100:00100000:1.0:1779690384.838109:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584640 00000100:00100000:1.0:1779690384.838136:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503584256 00000100:00100000:1.0:1779690384.838138:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503584256 00000100:00100000:1.0:1779690384.838155:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:1.0:1779690384.838296:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:2389:x1866137503584640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690384.838326:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:2389:x1866137503584640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690384.838356:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:3.0:1779690384.838365:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+30:2389:x1866137503584256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690384.838392:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+30:2389:x1866137503584256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690384.838398:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:1.0:1779690384.838448:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00080000:1.0:1779690384.838830:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690384.838836:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690384.838839:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1779690384.841995:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690385.865991:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690386.889072:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1779690387.401212:0:57584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3114975404503ns, next at 3115975401535ns, rc = 0 00000100:00100000:3.0:1779690387.401230:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492301568:0@lo:400:kworker.0 00000100:00100000:2.0:1779690387.401239:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690387.401312:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492301696:0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.403267:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690387.403334:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492302208:0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.403363:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690387.403413:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492301696 00000100:00100000:0.0:1779690387.403419:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492301696 00000100:00100000:0.0:1779690387.403472:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1779690387.403483:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492301696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.403546:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492301696:12345-0@lo:400:kworker.0 Request processed in 66us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690387.403553:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1779690387.403584:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492302208 00000100:00100000:0.0:1779690387.403588:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492302208 00000100:00100000:0.0:1779690387.403614:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:0.0:1779690387.403620:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.403651:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492302208:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690387.403656:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:0.0:1779690387.403671:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690387.403675:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690387.403707:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492301696:0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.404517:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492302208:0@lo:400:kworker.0 00000100:00100000:2.0:1779690387.405507:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690387.405568:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492302336:0@lo:400:kworker.0 00000100:00100000:1.0:1779690387.405581:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492301824 00000100:00100000:1.0:1779690387.405588:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492301824 00000100:00100000:2.0:1779690387.405614:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690387.405640:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1779690387.405650:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492301952:0@lo:400:kworker.0 00000100:00100000:1.0:1779690387.405650:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1779690387.405663:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492301824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690387.405677:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690387.405697:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492302464:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690387.405697:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690387.405726:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690387.405753:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492301824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690387.405762:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690387.405762:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1779690387.405788:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492302464 00000100:00100000:1.0:1779690387.405792:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492302464 00000100:00100000:1.0:1779690387.405825:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1779690387.405833:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492302464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690387.405851:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690387.405976:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492302464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690387.405992:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1779690387.406017:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492302336 00000100:00100000:1.0:1779690387.406027:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492302336 00000100:00100000:1.0:1779690387.406051:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492301952 00000100:00100000:1.0:1779690387.406054:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492301952 00000100:00100000:1.0:1779690387.406076:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1779690387.406082:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492302336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690387.406115:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492302336:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690387.406120:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1779690387.406132:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1779690387.406137:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492301952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690387.406162:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492301952:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690387.406167:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1779690387.406188:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690387.406202:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690387.406466:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492302464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690387.406478:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492302336:0@lo:400:kworker.0 00000100:00100000:2.0:1779690387.406510:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492301952:0@lo:400:kworker.0 00000100:00100000:3.0:1779690387.406691:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690387.406843:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492302080:0@lo:400:kworker.0 00000100:00100000:3.0:1779690387.406871:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690387.406959:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492302080 00000100:00100000:1.0:1779690387.406964:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492302080 00000100:00100000:1.0:1779690387.407098:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1779690387.407106:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492302080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690387.407144:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492302080:12345-0@lo:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690387.407150:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1779690387.407174:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492302080:0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.407175:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492301568 00000100:00100000:0.0:1779690387.407179:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492301568 00000100:00100000:0.0:1779690387.407241:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1779690387.407249:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492301568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690387.407292:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492301568:12345-0@lo:400:kworker.0 Request processed in 44us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690387.407298:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1779690387.407407:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492301568:0@lo:400:kworker.0 00000100:00100000:2.0:1779690387.577302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690387.577415:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585024 00000100:00100000:1.0:1779690387.577425:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585024 00000100:00100000:1.0:1779690387.577502:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 365 00000100:00100000:1.0:1779690387.577533:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+30:99608:x1866137503585024:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1779690387.577627:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+30:99608:x1866137503585024:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690387.577634:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 365 00000100:00080000:0.0:1779690387.578026:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690387.580091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690387.580168:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585280 00000100:00100000:3.0:1779690387.580176:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585280 00000100:00100000:3.0:1779690387.580225:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:3.0:1779690387.580234:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+30:99608:x1866137503585280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690387.580691:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+31:99608:x1866137503585280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 457us (605us total) trans 12884902076 rc 0/0 00000100:00100000:3.0:1779690387.580699:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00010000:00010000:2.0:1779690387.913020:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1779690388.692726:0:63238:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 202: Register/Cancel remove =========== 02:26:27 (1779690387) 00000100:00100000:1.0:1779690388.744981:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690388.745072:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585408 00000100:00100000:0.0:1779690388.745082:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585408 00000100:00100000:0.0:1779690388.745191:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 366 00000100:00100000:0.0:1779690388.745202:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:100297:x1866137503585408:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690388.745220:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690388.745251:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed98a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745325:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745340:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745353:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745367:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745375:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745381:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745623:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745632:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745639:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745644:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690388.745649:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745665:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745676:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:0.0:1779690388.745679:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690388.745683:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745689:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745702:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745708:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745714:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745719:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690388.745721:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745726:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745733:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54cfe9b4 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690388.745736:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690388.745738:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745753:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e16d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745784:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e15f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed98a expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745793:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:0.0:1779690388.745795:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690388.745799:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed98a expref: 29 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690388.745833:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ce00, rc 0) 00000100:00080000:1.0:1779690388.745975:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690388.746002:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+28:100297:x1866137503585408:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 800us (1028us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690388.746013:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 366 00000100:00100000:2.0:1779690388.754094:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690388.754171:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585664 00000100:00100000:1.0:1779690388.754191:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585664 00000100:00100000:1.0:1779690388.754252:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 367 00000100:00100000:1.0:1779690388.754264:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+28:100297:x1866137503585664:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:1.0:1779690388.754327:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690388.754354:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913dfde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed921 expref: 28 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.754372:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690388.754378:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690388.755168:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.755195:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 30 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.755205:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.755237:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 30 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.755258:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 30 pid: 57559 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690388.755273:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492302592:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690388.755369:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f903b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690388.765510:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690388.765711:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585792 00000100:00100000:2.0:1779690388.765721:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585792 00010000:00010000:2.0:1779690388.765762:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 31 pid: 57559 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690388.765840:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3213 00000100:00100000:2.0:1779690388.765852:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+31:2391:x1866137503585792:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690388.765876:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690388.765884:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 31 pid: 57559 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690388.765898:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492302592:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690388.765907:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 31 pid: 57559 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.766034:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed92f expref: 31 pid: 57559 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.766037:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.766053:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690388.766059:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.766067:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.766075:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.766098:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690388.766118:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.766127:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690388.766152:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+30:2391:x1866137503585792:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 302us (649us total) trans 0 rc 0/0 00010000:00010000:1.0:1779690388.766152:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690388.766166:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3213 00010000:00010000:1.0:1779690388.766175:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.766184:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690388.767845:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x78:0x0]: returning size 512 00010000:00010000:2.0:1779690388.767874:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.767884:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.768063:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.768072:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690388.768076:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.768084:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.768098:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690388.768101:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690388.768105:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.768110:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e174 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690388.768128:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f2acd29b reply state 00000000885cea06 transno 12884902077 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690388.768136:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690388.768215:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+29:100297:x1866137503585664:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 13952us (14129us total) trans 12884902077 rc 0/0 00000100:00100000:2.0:1779690388.768223:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 367 00010000:00010000:3.0:1779690388.775384:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775400:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775409:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775432:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690388.775437:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775445:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775462:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54cfe9b4 (ffff9e2f903c9500) 00010000:00010000:3.0:1779690388.775465:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.775470:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.775476:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e17b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690388.800523:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690388.800835:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503585920 00000100:00100000:1.0:1779690388.800845:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503585920 00000100:00100000:1.0:1779690388.800905:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 368 00000100:00100000:1.0:1779690388.800915:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+30:100304:x1866137503585920:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690388.800944:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690388.800964:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed991 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801020:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801033:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801043:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690388.801096:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:1.0:1779690388.801100:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 99 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690388.801120:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801140:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed991 expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801155:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed991 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.801163:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:1.0:1779690388.801166:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690388.801169:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8000, rc 0) 00000100:00100000:1.0:1779690388.801235:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+31:100304:x1866137503585920:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 322us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690388.801242:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 368 00000100:00100000:0.0:1779690388.807643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690388.807759:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503586176 00000100:00100000:1.0:1779690388.807769:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503586176 00000100:00100000:1.0:1779690388.807849:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 369 00000100:00100000:1.0:1779690388.807859:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+31:100304:x1866137503586176:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:1.0:1779690388.807922:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690388.807948:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed991 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.807966:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9600) 00010000:00010000:1.0:1779690388.807979:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690388.808133:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+30:100304:x1866137503586176:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 276us (498us total) trans 0 rc -17/-17 00000100:00100000:1.0:1779690388.808141:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 369 00000100:00100000:0.0:1779690388.817066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690388.817392:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503586304 00000100:00100000:2.0:1779690388.817408:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503586304 00000100:00100000:2.0:1779690388.818721:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 370 00000100:00100000:2.0:1779690388.818736:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+30:100304:x1866137503586304:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690388.818755:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690388.818777:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed998 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820097:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820115:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820125:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690388.820370:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690388.820375:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 99 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690388.820403:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820429:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820443:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.820451:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690388.820454:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690388.820458:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad600, rc 0) 00000100:00100000:2.0:1779690388.821072:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+31:100304:x1866137503586304:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 2338us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690388.821082:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 370 00000100:00100000:3.0:1779690388.826970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690388.827030:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503586432 00000100:00100000:1.0:1779690388.827040:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503586432 00000100:00100000:1.0:1779690388.827096:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 371 00000100:00100000:1.0:1779690388.827107:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+31:100304:x1866137503586432:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690388.827127:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690388.827147:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed99f expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827206:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827220:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827232:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827265:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827273:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827280:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827386:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827394:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827401:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690388.827436:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x78:0x0]: returning size 512 00000004:00200000:1.0:1779690388.827439:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690388.827460:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827470:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827477:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827484:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827499:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690388.827504:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827511:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827534:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690388.827539:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690388.827544:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827552:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827565:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827570:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827576:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827580:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690388.827582:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827587:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827606:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54cfe9b4 (ffff9e2f903c9a00) 00010000:00010000:1.0:1779690388.827608:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690388.827611:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827617:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e1ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827648:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed99f expref: 33 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827660:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed99f expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690388.827667:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690388.827670:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690388.827672:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9c00, rc 0) 00000100:00100000:1.0:1779690388.827736:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+32:100304:x1866137503586432:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 630us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690388.827743:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 371 00000100:00100000:1.0:1779690388.839646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690388.839709:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503586560 00000100:00100000:3.0:1779690388.839718:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503586560 00000100:00100000:3.0:1779690388.839779:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 372 00000100:00100000:3.0:1779690388.839789:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+32:100309:x1866137503586560:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690388.839900:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690388.840066:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e1ba lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9a6 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840131:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840145:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840170:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840236:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840245:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840252:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840329:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840337:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840343:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840348:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690388.840352:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840359:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840370:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690388.840373:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.840377:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840389:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840400:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840406:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840412:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840417:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690388.840419:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840425:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840432:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x46164cd8 (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690388.840434:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.840437:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840443:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840473:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e1ba lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9a6 expref: 33 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840493:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690388.840495:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.840499:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e1ba lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9a6 expref: 33 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.840508:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e400, rc 0) 00000100:00100000:3.0:1779690388.840603:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+32:100309:x1866137503586560:12345-192.168.203.5@tcp:101:rm.0 Request processed in 815us (965us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690388.840611:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 372 00000100:00100000:3.0:1779690388.858612:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690388.858643:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503586816 00000100:00100000:3.0:1779690388.858652:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503586816 00000100:00100000:3.0:1779690388.858701:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 373 00000100:00100000:3.0:1779690388.858710:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+32:100311:x1866137503586816:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1779690388.858729:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690388.858732:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690388.858757:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e1b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed99f expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858771:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690388.858781:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690388.858795:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e1cf lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9ad expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858936:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858955:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858964:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858977:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858984:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.858989:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690388.859585:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e8:0x0], index 1: 0 00010000:00010000:3.0:1779690388.859954:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e1e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.859966:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.859974:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860005:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860012:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860019:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860031:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690388.860035:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860042:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860052:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f883cbb00) 00010000:00010000:3.0:1779690388.860055:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.860060:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860066:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e1d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690388.860078:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000091e508cd reply state 0000000087085df8 transno 12884902078 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690388.860087:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690388.860115:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e1cf lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9ad expref: 34 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860132:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f200/0xb4bb873a1913e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9ad expref: 33 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.860139:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690388.860142:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690388.860144:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f200, rc 0) 00000100:00100000:3.0:1779690388.860204:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100311:x1866137503586816:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1495us (1597us total) trans 12884902078 rc 0/0 00000100:00100000:3.0:1779690388.860216:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 373 00010000:00010000:3.0:1779690388.865752:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865768:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865776:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865784:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690388.865788:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865796:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865927:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x46164cd8 (ffff9e2f883cb600) 00010000:00010000:3.0:1779690388.865931:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690388.865936:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690388.865942:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e1dd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690388.874691:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690388.877987:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587072 00000100:00100000:2.0:1779690388.878002:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587072 00000100:00100000:0.0:1779690388.881193:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1779690388.881206:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+33:100311:x1866137503587072:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690388.881574:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100311:x1866137503587072:12345-192.168.203.5@tcp:35:dd.0 Request processed in 371us (6889us total) trans 12884902079 rc 0/0 00000100:00100000:0.0:1779690388.881583:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:1.0:1779690388.906057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690388.906150:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587200 00000100:00100000:2.0:1779690388.906160:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587200 00000100:00100000:2.0:1779690388.906219:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 374 00000100:00100000:2.0:1779690388.906229:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+34:100314:x1866137503587200:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690388.906251:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690388.906270:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e1f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9b4 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906333:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906347:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906359:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906372:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906379:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906385:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906511:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913e207 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906520:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913e207 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906527:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913e207 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690388.906559:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x78:0x0]: returning size 512 00000004:00200000:2.0:1779690388.906562:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690388.906583:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913e207 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906593:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906599:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906606:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906612:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690388.906617:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906625:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906637:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690388.906646:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690388.906651:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906656:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e1f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906668:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906673:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906679:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906684:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690388.906686:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906691:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906698:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54cfe9b4 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690388.906701:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690388.906703:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906708:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e200 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906735:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e1f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9b4 expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906761:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812aca00/0xb4bb873a1913e207 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9b4 expref: 35 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690388.906768:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690388.906771:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690388.906773:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812aca00, rc 0) 00000100:00100000:2.0:1779690388.906853:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:100314:x1866137503587200:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 626us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690388.906870:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 374 00010000:00010000:0.0:1779690388.937429:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690389.061537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690389.061721:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587456 00000100:00100000:3.0:1779690389.061732:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587456 00000100:00100000:3.0:1779690389.061849:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 375 00000100:00100000:3.0:1779690389.061868:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:100340:x1866137503587456:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690389.061902:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690389.061923:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e20e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9bb expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.061993:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.062008:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.062019:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.062033:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.062039:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.062045:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690389.062418:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690389.063082:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e223 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.063095:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e223 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.063102:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e223 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690389.063111:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1779690389.063259:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.063267:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.063272:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.063278:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690389.063282:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065559:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065588:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:3.0:1779690389.065591:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690389.065598:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065606:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e215 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065743:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065752:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065759:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065783:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690389.065787:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065793:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065841:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f883cb600) 00010000:00010000:3.0:1779690389.065844:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690389.065848:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.065854:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e21c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.066285:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e20e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9bb expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.066302:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e223 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9bb expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.066309:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690389.067763:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690389.067769:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f000, rc 0) 00000100:00100000:3.0:1779690389.067870:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100340:x1866137503587456:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6002us (6330us total) trans 12884902080 rc 0/0 00000100:00100000:3.0:1779690389.067880:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 375 00000100:00100000:1.0:1779690389.082714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.082895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.087728:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690389.088597:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587840 00000100:00100000:0.0:1779690389.088608:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587840 00000100:00100000:0.0:1779690389.088694:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18648 00000100:00100000:0.0:1779690389.088705:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+37:2389:x1866137503587840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690389.088739:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690389.088764:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e223 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9bb expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.088785:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690389.088789:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690389.088885:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+36:2389:x1866137503587840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 182us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.088892:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18648 00000100:00100000:2.0:1779690389.089613:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587584 00000100:00100000:2.0:1779690389.089619:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587584 00000100:00100000:2.0:1779690389.089666:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587712 00000100:00100000:2.0:1779690389.089669:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587712 00000100:00100000:2.0:1779690389.089700:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 376 00000100:00100000:2.0:1779690389.089708:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:100340:x1866137503587584:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690389.089785:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:100340:x1866137503587584:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 77us (7080us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.089792:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 376 00000100:00100000:2.0:1779690389.089827:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 377 00000100:00100000:2.0:1779690389.089834:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+28:100341:x1866137503587712:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690389.089845:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690389.089870:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9c2 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.089916:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.089936:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.089946:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690389.090013:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:2.0:1779690389.090018:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 99 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690389.090042:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.090062:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9c2 expref: 30 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.090076:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9c2 expref: 29 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.090083:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690389.090086:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690389.090088:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:2.0:1779690389.090112:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:100341:x1866137503587712:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 278us (7217us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.090119:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 377 00000100:00100000:1.0:1779690389.097941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690389.098496:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503587968 00000100:00100000:3.0:1779690389.098518:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503587968 00000100:00100000:3.0:1779690389.098716:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 378 00000100:00100000:3.0:1779690389.098727:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+29:100341:x1866137503587968:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690389.098748:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690389.098768:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9c9 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098855:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098879:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098891:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098906:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098912:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.098918:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099031:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e254 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099039:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e254 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099046:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e254 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690389.099086:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x78:0x0]: returning size 512 00000004:00200000:3.0:1779690389.099090:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690389.099111:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e254 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099123:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099130:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099136:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099141:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690389.099145:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099152:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099164:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:3.0:1779690389.099168:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690389.099172:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099178:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099190:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099206:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099212:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099216:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690389.099219:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099224:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099230:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54cfe9b4 (ffff9e2f883cb600) 00010000:00010000:3.0:1779690389.099232:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690389.099234:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099239:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e24d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54cfe9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099267:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9c9 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099280:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53f000/0xb4bb873a1913e254 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9c9 expref: 30 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.099287:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:3.0:1779690389.099301:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690389.099318:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53f000, rc 0) 00000100:00100000:3.0:1779690389.099379:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+30:100341:x1866137503587968:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 654us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690389.099386:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 378 00000100:00100000:2.0:1779690389.105549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690389.107685:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588096 00000100:00100000:0.0:1779690389.107698:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588096 00000100:00100000:0.0:1779690389.107815:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 379 00000100:00100000:0.0:1779690389.107826:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+30:100341:x1866137503588096:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690389.107845:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690389.107875:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e25b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9d0 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.107934:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.107948:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.107959:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.107982:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108006:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108012:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108100:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108108:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108114:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690389.108144:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x13:0x0]: returning size 0 00000004:00200000:0.0:1779690389.108148:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690389.108164:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108173:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108180:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108186:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108193:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108208:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690389.108211:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108218:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108229:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:0.0:1779690389.108232:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690389.108236:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108241:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e262 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108255:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108261:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108266:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108270:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690389.108273:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108279:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108293:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x46164cd8 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690389.108296:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690389.108298:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108304:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e269 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x46164cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108345:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c000/0xb4bb873a1913e25b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x78:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9d0 expref: 32 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108358:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c200/0xb4bb873a1913e270 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9d0 expref: 31 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.108365:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:0.0:1779690389.108367:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690389.108370:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c200, rc 0) 00000100:00100000:0.0:1779690389.108432:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:100341:x1866137503588096:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 608us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.108439:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 379 00000100:00100000:0.0:1779690389.114928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.115043:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588224 00000100:00100000:1.0:1779690389.115052:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588224 00000100:00100000:1.0:1779690389.115169:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6378 00000100:00100000:1.0:1779690389.115181:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+14:2392:x1866137503588224:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690389.115197:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690389.115215:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008023fb26/0xb4bb873a1913e277 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9d7 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690389.115241:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690389.115258:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690389.115260:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690389.115269:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008023fb26/0xb4bb873a1913e277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9d7 expref: 15 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.115284:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008023fb26/0xb4bb873a1913e277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9d7 expref: 15 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.115297:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8800, rc 0) 00000100:00100000:1.0:1779690389.115363:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503588224:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 185us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690389.115370:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6378 00000100:00080000:0.0:1779690389.115692:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690389.117856:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.118399:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588352 00000100:00100000:2.0:1779690389.118408:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588352 00000100:00100000:2.0:1779690389.118461:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 380 00000100:00100000:2.0:1779690389.118470:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+31:100341:x1866137503588352:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690389.118505:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690389.118523:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9de expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.118585:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e285 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.118600:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.118612:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690389.119037:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x78:0x0]: returning size 512 00000004:00200000:2.0:1779690389.119042:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690389.119071:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.119097:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9de expref: 33 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.119113:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad200/0xb4bb873a1913e285 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x78:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9de expref: 32 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.119121:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x78:0x0].0x0 (ffff9e2f826ecb00) 00010000:00010000:2.0:1779690389.119124:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690389.119126:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad200, rc 0) 00000100:00100000:2.0:1779690389.119739:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+32:100341:x1866137503588352:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1268us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.119748:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 380 00000100:00100000:3.0:1779690389.125924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.126101:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588608 00000100:00100000:2.0:1779690389.126110:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588608 00000100:00100000:2.0:1779690389.126166:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 381 00000100:00100000:2.0:1779690389.126175:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+32:100341:x1866137503588608:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690389.126556:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].17, 136 off10504 00000100:00100000:2.0:1779690389.126642:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+32:100341:x1866137503588608:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 467us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.126649:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 381 00000040:00080000:1.0:1779690389.129140:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690389.129146:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690389.129181:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 18 count 13 00000040:00080000:1.0:1779690389.129188:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690389.129416:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492302720:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690389.129512:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f903b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690389.131761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690389.131912:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588736 00000100:00100000:0.0:1779690389.131920:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588736 00000100:00100000:0.0:1779690389.131975:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 382 00000100:00100000:0.0:1779690389.131985:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503588736:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690389.132013:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690389.132120:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503588736:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.132127:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 382 00000100:00100000:1.0:1779690389.132439:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492302720:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690389.138633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.138735:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503588992 00000100:00100000:2.0:1779690389.138745:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503588992 00000100:00100000:2.0:1779690389.138846:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 383 00000100:00100000:2.0:1779690389.138857:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:100342:x1866137503588992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690389.138887:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690389.138905:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e28c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9e5 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.138997:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e293 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.139012:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.139024:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690389.139035:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x13:0x0]: returning size 0 00010000:00010000:2.0:1779690389.139155:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e28c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9e5 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.139189:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9e5 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.139197:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:2.0:1779690389.139200:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690389.139203:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ee00, rc 0) 00000100:00100000:2.0:1779690389.139264:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503588992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 409us (639us total) trans 12884902081 rc 0/0 00000100:00100000:2.0:1779690389.139270:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 383 00000100:00100000:3.0:1779690389.145415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.145501:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503589120 00000100:00100000:1.0:1779690389.145510:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503589120 00000100:00100000:1.0:1779690389.145580:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6379 00000100:00100000:1.0:1779690389.145589:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503589120:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690389.145637:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145652:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690389.145655:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690389.145659:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145682:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145713:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145722:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145730:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145738:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690389.145742:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145765:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145781:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.145789:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005bc9271/0xb4bb873a1913e2a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690389.146098:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503589120:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 509us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690389.146105:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6379 00000100:00080000:0.0:1779690389.146157:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690389.155159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690389.155644:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503589248 00000100:00100000:0.0:1779690389.155654:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503589248 00000100:00100000:0.0:1779690389.155731:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18649 00000100:00100000:0.0:1779690389.155740:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+38:2392:x1866137503589248:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690389.155755:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690389.155778:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e293 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9e5 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.155796:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:0.0:1779690389.155801:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690389.155886:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+37:2392:x1866137503589248:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 147us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.155893:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18649 00000100:00100000:3.0:1779690389.166913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.167076:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503589504 00000100:00100000:1.0:1779690389.167085:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503589504 00000100:00100000:1.0:1779690389.167159:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 384 00000100:00100000:1.0:1779690389.167169:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503589504:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690389.167278:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503589504:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 110us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690389.167286:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 384 00000100:00100000:3.0:1779690389.177556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.177742:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503589632 00000100:00100000:1.0:1779690389.177752:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503589632 00000100:00100000:0.0:1779690389.177922:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6380 00000100:00100000:0.0:1779690389.177939:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503589632:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690389.177956:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690389.177984:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76fabac/0xb4bb873a1913e2a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9ec expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.178010:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690389.178012:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690389.178020:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76fabac/0xb4bb873a1913e2a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9ec expref: 10 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.178057:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e76fabac/0xb4bb873a1913e2a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9ec expref: 10 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.178070:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c000, rc 0) 00000100:00100000:0.0:1779690389.178129:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503589632:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 197us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.184895:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6380 00000100:00100000:3.0:1779690389.184924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.186551:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503589888 00000100:00100000:2.0:1779690389.186562:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503589888 00000100:00100000:2.0:1779690389.186615:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 385 00000100:00100000:2.0:1779690389.186625:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503589888:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690389.186739:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503589888:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 116us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.186747:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 385 00000100:00100000:2.0:1779690389.191392:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.191459:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590016 00000100:00100000:2.0:1779690389.191468:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590016 00000100:00100000:2.0:1779690389.191519:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 386 00000100:00100000:2.0:1779690389.191529:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100342:x1866137503590016:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690389.191548:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690389.191567:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e2af lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9f3 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191620:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191633:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191645:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191738:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e2af lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191755:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.191764:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:2.0:1779690389.191767:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690389.191770:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e400, rc 0) 00000100:00100000:2.0:1779690389.191877:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590016:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 349us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.191885:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 386 00000100:00100000:0.0:1779690389.201193:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690389.201405:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590144 00000100:00100000:3.0:1779690389.201414:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590144 00000100:00100000:3.0:1779690389.201502:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 387 00000100:00100000:3.0:1779690389.201511:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690389.201543:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690389.201640:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690389.201648:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 387 00000100:00100000:2.0:1779690389.208277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690389.208381:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590272 00000100:00100000:0.0:1779690389.208392:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590272 00000100:00100000:0.0:1779690389.208448:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6381 00000100:00100000:0.0:1779690389.208456:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503590272:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690389.208502:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208517:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690389.208519:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690389.208524:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208536:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208563:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208586:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208593:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208600:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ce00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690389.208603:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208613:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208627:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690389.208635:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b66bb015/0xb4bb873a1913e2bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690389.208712:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503590272:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 256us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690389.208720:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6381 00000100:00100000:0.0:1779690389.210684:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690389.210761:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590528 00000100:00100000:1.0:1779690389.210767:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590528 00000100:00100000:1.0:1779690389.210886:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 388 00000100:00100000:1.0:1779690389.210895:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590528:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690389.210967:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.210983:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.210992:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.211024:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690389.211037:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 38 pid: 57560 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690389.211051:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492302848:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690389.211129:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f903b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690389.215946:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.216042:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492302848:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690389.216070:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690389.216136:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590656 00000100:00100000:3.0:1779690389.216143:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590656 00010000:00010000:3.0:1779690389.216174:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 39 pid: 57560 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690389.216206:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3214 00000100:00100000:3.0:1779690389.216214:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+39:2389:x1866137503590656:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690389.216233:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690389.216240:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 39 pid: 57560 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216251:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 39 pid: 57560 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216271:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e2b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9f3 expref: 39 pid: 57560 timeout: 3216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216284:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690389.216288:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216298:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216305:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.216329:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690389.216373:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+38:2389:x1866137503590656:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 159us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690389.216380:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3214 00010000:00010000:2.0:1779690389.216592:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216606:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216794:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216801:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216840:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216846:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690389.216850:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216856:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216875:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:2.0:1779690389.216877:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690389.216880:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.216886:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e2c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690389.217003:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590528:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 6108us (6324us total) trans 12884902082 rc 0/0 00000100:00100000:2.0:1779690389.217011:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 388 00000040:00080000:3.0:1779690389.217321:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690389.217326:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690389.221801:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:3.0:1779690389.221828:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690389.223584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.223714:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503590912 00000100:00100000:2.0:1779690389.223724:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503590912 00000100:00100000:2.0:1779690389.223779:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1779690389.223788:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100342:x1866137503590912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690389.224119:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+39:100342:x1866137503590912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 331us (541us total) trans 12884902083 rc 0/0 00000100:00100000:2.0:1779690389.224128:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000001:00080000:1.0:1779690389.509635:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968338 is committed 00000001:00080000:2.0:1779690389.543191:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902079 is committed 00000001:00080000:2.0:1779690389.543282:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902083 is committed 00000001:00080000:2.0:1779690389.543296:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902077 is committed 00000004:00080000:2.0:1779690389.543302:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1779690389.543480:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690389.543499:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492302976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1779690389.543568:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690389.543599:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492302976 00000100:00100000:3.0:1779690389.543606:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492302976 00000100:00100000:3.0:1779690389.543708:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6382 00000100:00100000:3.0:1779690389.543718:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492302976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1779690389.543743:0:15940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:488 count 1 00002000:00010000:3.0:1779690389.543775:0:15940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a13eb8e, blocks: 0x1 00010000:00010000:3.0:1779690389.543783:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.543797:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690389.543799:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690389.543913:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.543930:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.543942:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.543949:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690389.543972:0:15940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690389.544004:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690389.544012:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.544021:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690389.544026:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.544035:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.544052:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.544061:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913e2cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690389.544091:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690389.544092:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690389.544094:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690389.544510:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492302976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 793us (941us total) trans 4294968339 rc 0/0 00000100:00100000:3.0:1779690389.544518:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6382 00000100:00100000:0.0:1779690389.544663:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968338 gen 2 00000004:00080000:0.0:1779690389.544674:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f8f153100, transno 4294968338 00000100:00100000:0.0:1779690389.544693:0:3319:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e308658bb80 x1866137492302976/t4294968339(4294968339) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1779690405 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1779690389.544703:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e308658bb80/2, rc 0, transno 4294968339 00000100:00100000:0.0:1779690389.544707:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492302976:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1779690389.544873:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1779690389.731012:0:63290:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690389.731022:0:63290:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690389.731111:0:63290:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 18 count 13 00000040:00080000:1.0:1779690389.731117:0:63290:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690389.935597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.935696:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591168 00000100:00100000:2.0:1779690389.935705:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591168 00000100:00100000:2.0:1779690389.935763:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 389 00000100:00100000:2.0:1779690389.935773:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:100360:x1866137503591168:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690389.936416:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].18, 136 off10640 00000100:00100000:3.0:1779690389.936506:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:100360:x1866137503591168:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 734us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690389.936513:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 389 00000100:00100000:2.0:1779690389.958999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959207:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959276:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690389.959351:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591552 00000100:00100000:2.0:1779690389.959360:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591552 00000100:00100000:2.0:1779690389.959412:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591808 00000100:00100000:2.0:1779690389.959415:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591808 00000100:00100000:2.0:1779690389.959434:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591680 00000100:00100000:2.0:1779690389.959436:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591680 00000100:00100000:2.0:1779690389.959451:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591936 00000100:00100000:2.0:1779690389.959454:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591936 00000100:00100000:3.0:1779690389.959459:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2796 00000100:00100000:3.0:1779690389.959471:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503591552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690389.959542:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503591552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690389.961344:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591296 00000100:00100000:1.0:1779690389.961356:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591296 00000100:00100000:1.0:1779690389.961416:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:1.0:1779690389.961439:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503591296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690389.961497:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503591296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690389.961504:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:2.0:1779690389.962245:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2797 00000100:00100000:2.0:1779690389.962258:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503591808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690389.962933:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503591808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 677us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.962941:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2797 00000100:00100000:2.0:1779690389.962972:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2798 00000100:00100000:2.0:1779690389.962979:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503591680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690389.963003:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503591680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.963009:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2798 00000100:00100000:2.0:1779690389.963017:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2799 00000100:00100000:2.0:1779690389.963022:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503591936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690389.963039:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503591936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 16us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.963044:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2799 00010000:00010000:2.0:1779690389.963103:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690389.963127:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503591424 00000100:00100000:2.0:1779690389.963133:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503591424 00000100:00100000:2.0:1779690389.963166:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:2.0:1779690389.963172:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:2390:x1866137503591424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690389.963205:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:2390:x1866137503591424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690389.963211:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00080000:0.0:1779690389.966312:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690389.969027:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2796 00000040:00080000:1.0:1779690390.285547:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690390.285555:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690390.285603:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 19 count 14 00000040:00080000:1.0:1779690390.285611:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690390.285729:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492303104:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690390.285839:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f810f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690390.297388:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492303104:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1779690390.657441:0:63341:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690390.657450:0:63341:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690390.657521:0:63341:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 19 count 14 00000040:00080000:1.0:1779690390.657527:0:63341:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690390.742260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690390.749974:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592192 00000100:00100000:0.0:1779690390.749988:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592192 00000100:00100000:0.0:1779690390.750071:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 390 00000100:00100000:0.0:1779690390.750081:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:100370:x1866137503592192:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1779690390.750201:0:57559:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690390.750206:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690390.750240:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 19 count 14 00000040:00080000:0.0:1779690390.750246:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690390.750507:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].19, 136 off10776 00000100:00100000:0.0:1779690390.750592:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:100370:x1866137503592192:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 512us (8339us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690390.750600:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 390 00000100:00080000:2.0:1779690390.750778:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690390.988137:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690391.305391:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690391.305398:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690391.305435:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 20 count 15 00000040:00080000:1.0:1779690391.305442:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690391.306210:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492303232:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690391.306629:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3091c03f00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690391.308754:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492303232:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1779690391.361745:0:63393:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690391.361753:0:63393:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690391.362976:0:63393:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 20 count 15 00000040:00080000:0.0:1779690391.362983:0:63393:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690392.010393:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690392.329037:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690392.329046:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690392.329434:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 20 count 13 00000040:00080000:1.0:1779690392.329441:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690392.527154:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492303360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690392.527219:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690392.528163:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690392.528177:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492303488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690392.528217:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690392.528267:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492303360 00000100:00100000:1.0:1779690392.528285:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492303360 00000100:00100000:1.0:1779690392.528345:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492303488 00000100:00100000:1.0:1779690392.528349:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492303488 00000100:00100000:1.0:1779690392.528368:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1779690392.528376:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492303360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690392.528413:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690392.528461:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492303360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690392.528469:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1779690392.528485:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1779690392.528492:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492303488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690392.528510:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690392.528540:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492303488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690392.528547:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00080000:1.0:1779690392.528566:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690392.528570:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690392.528604:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492303360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690392.528635:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492303488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690392.536025:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690392.536047:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492303744:0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.536114:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690392.536210:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492303744 00000100:00100000:1.0:1779690392.536218:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492303744 00000100:00100000:1.0:1779690392.536270:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1779690392.536420:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492303616:0@lo:400:kworker.0 00000100:00100000:0.0:1779690392.536461:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690392.536500:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492303616 00000100:00100000:0.0:1779690392.536504:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492303616 00000100:00100000:0.0:1779690392.536534:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1779690392.536540:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492303616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690392.536586:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492303616:12345-0@lo:400:kworker.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690392.536592:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1779690392.536636:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492303616:0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.536934:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492303744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537027:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492303744:12345-0@lo:400:kworker.0 Request processed in 748us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690392.537034:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1779690392.537056:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690392.537101:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492304000:0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537127:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690392.537173:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690392.537181:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492303872:0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537205:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690392.537235:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304000 00000100:00100000:1.0:1779690392.537239:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304000 00000100:00100000:1.0:1779690392.537262:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492303872 00000100:00100000:1.0:1779690392.537264:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492303872 00000100:00100000:1.0:1779690392.537472:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1779690392.537480:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537519:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492304000:12345-0@lo:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690392.537525:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1779690392.537539:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1779690392.537545:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492303872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537574:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492303872:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690392.537580:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1779690392.537619:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492303872:0@lo:400:kworker.0 00000100:00100000:1.0:1779690392.537640:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492304000:0@lo:400:kworker.0 00000100:00080000:1.0:1779690392.537650:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690392.538180:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492303744:0@lo:400:kworker.0 00010000:00010000:2.0:1779690393.032973:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690394.058611:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690394.625937:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968339 is committed 00000100:00100000:3.0:1779690395.071983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072016:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072062:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072120:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.072147:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592576 00000100:00100000:3.0:1779690395.072155:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592576 00000100:00100000:3.0:1779690395.072204:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593088 00000100:00100000:3.0:1779690395.072207:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593088 00000100:00100000:3.0:1779690395.072224:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592704 00000100:00100000:3.0:1779690395.072226:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592704 00000100:00100000:3.0:1779690395.072243:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592960 00000100:00100000:3.0:1779690395.072245:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592960 00000100:00100000:3.0:1779690395.072271:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2800 00000100:00100000:3.0:1779690395.072280:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503592576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072353:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+21:2390:x1866137503592576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 74us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072361:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2800 00000100:00100000:3.0:1779690395.072378:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2801 00000100:00100000:3.0:1779690395.072384:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503593088:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072405:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503593088:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072411:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2801 00000100:00100000:3.0:1779690395.072421:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2802 00000100:00100000:3.0:1779690395.072426:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503592704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072444:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503592704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 17us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072450:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2802 00000100:00100000:3.0:1779690395.072461:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2803 00000100:00100000:3.0:1779690395.072466:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503592960:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072484:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503592960:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 18us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072489:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2803 00000100:00100000:3.0:1779690395.072507:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592832 00000100:00100000:3.0:1779690395.072510:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592832 00000100:00100000:3.0:1779690395.072537:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592448 00000100:00100000:3.0:1779690395.072540:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592448 00000100:00100000:3.0:1779690395.072557:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1779690395.072562:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:2390:x1866137503592832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072610:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+31:2390:x1866137503592832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072617:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1779690395.072629:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1779690395.072636:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+32:2390:x1866137503592448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690395.072658:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+32:2390:x1866137503592448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.072663:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00080000:3.0:1779690395.072688:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690395.072692:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690395.072695:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690395.075021:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503592320 00000100:00100000:2.0:1779690395.075032:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503592320 00000100:00100000:2.0:1779690395.075096:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:2.0:1779690395.075105:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503592320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690395.075173:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503592320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690395.075192:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00010000:00010000:3.0:1779690395.081005:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690395.409629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690395.409724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690395.409872:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593216 00000100:00100000:2.0:1779690395.409882:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593216 00000100:00100000:2.0:1779690395.409925:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593344 00000100:00100000:2.0:1779690395.409929:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593344 00000100:00100000:2.0:1779690395.409952:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 391 00000100:00100000:2.0:1779690395.409960:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+33:100801:x1866137503593216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690395.409990:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690395.410086:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+33:100801:x1866137503593216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 125us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690395.410094:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 391 00000100:00100000:2.0:1779690395.410110:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 392 00000100:00100000:2.0:1779690395.410118:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:100802:x1866137503593344:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690395.410129:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690395.410158:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:100802:x1866137503593344:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690395.410164:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 392 00000100:00100000:3.0:1779690395.423352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690395.426143:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593600 00000100:00100000:2.0:1779690395.426156:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593600 00000100:00100000:2.0:1779690395.426349:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 393 00000100:00100000:2.0:1779690395.426359:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+32:100801:x1866137503593600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690395.426378:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690395.426397:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e2d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bed9fa expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690395.427280:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e2d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690395.427300:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690395.427315:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690395.427329:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x13:0x0]: returning size 0 00010000:00010000:2.0:1779690395.427672:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e2d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9fa expref: 35 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690395.427693:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9fa expref: 34 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690395.427701:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:2.0:1779690395.427704:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690395.427708:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:2.0:1779690395.427875:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+34:100801:x1866137503593600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1516us (4530us total) trans 12884902084 rc 0/0 00000100:00100000:2.0:1779690395.427894:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 393 00000100:00100000:2.0:1779690395.432187:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690395.432265:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593856 00000100:00100000:1.0:1779690395.432274:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593856 00000100:00100000:1.0:1779690395.432330:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 394 00000100:00100000:1.0:1779690395.432341:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+34:100801:x1866137503593856:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690395.432418:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432435:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432448:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432657:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432782:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432789:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432907:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690395.432912:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432930:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432943:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:1.0:1779690395.432946:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690395.432951:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690395.432958:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e2e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690395.433177:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:100801:x1866137503593856:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 838us (996us total) trans 12884902085 rc 0/0 00000100:00100000:1.0:1779690395.433186:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 394 00000100:00100000:3.0:1779690395.435001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.435027:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503593984 00000100:00100000:3.0:1779690395.435035:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503593984 00000100:00100000:3.0:1779690395.435082:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18650 00000100:00100000:3.0:1779690395.435091:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+35:2389:x1866137503593984:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690395.435104:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690395.435125:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e2d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9fa expref: 35 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690395.435141:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x13:0x0].0x0 (ffff9e2f883cb500) 00010000:00010000:3.0:1779690395.435145:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690395.435185:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+34:2389:x1866137503593984:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690395.435206:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18650 00000100:00100000:3.0:1779690395.435354:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000040:00080000:2.0:1779690395.436342:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690395.436348:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690395.437143:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:2.0:1779690395.437153:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690395.437222:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503594240 00000100:00100000:2.0:1779690395.437229:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503594240 00000100:00100000:2.0:1779690395.437311:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:2.0:1779690395.437319:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100801:x1866137503594240:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690395.437525:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+35:100801:x1866137503594240:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 206us (2170us total) trans 12884902086 rc 0/0 00000100:00100000:2.0:1779690395.437534:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1779690395.497240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690395.497482:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503594368 00000100:00100000:0.0:1779690395.497492:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503594368 00000100:00100000:0.0:1779690395.497556:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 395 00000100:00100000:0.0:1779690395.497566:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:100340:x1866137503594368:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1779690395.497682:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:100340:x1866137503594368:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 118us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690395.497689:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 395 00000100:00100000:1.0:1779690395.500483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690395.500556:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503594624 00000100:00100000:3.0:1779690395.500565:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503594624 00000100:00100000:3.0:1779690395.500661:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:3.0:1779690395.500672:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+35:100340:x1866137503594624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690395.501147:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+36:100340:x1866137503594624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 476us (737us total) trans 12884902087 rc 0/0 00000100:00100000:3.0:1779690395.501155:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00010000:00010000:2.0:1779690396.105148:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690396.487225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690396.487319:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503594752 00000100:00100000:0.0:1779690396.487329:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503594752 00000100:00100000:0.0:1779690396.487403:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18651 00000100:00100000:0.0:1779690396.487415:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503594752:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690396.487439:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 15 locks, starting at 0 00002000:00010000:0.0:1779690396.487460:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1e5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487486:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047837bb7/0xb4bb873a1913d87c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed688 expref: 21 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487522:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1e2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487530:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913cd85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed339 expref: 20 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487548:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1c5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487554:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca38b9c7/0xb4bb873a1913c8a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed291 expref: 19 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487573:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1bb:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487579:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834579c8/0xb4bb873a1913b074 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec1a4 expref: 18 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487594:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1ba:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487601:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be05c30/0xb4bb873a1913af40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec134 expref: 17 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487616:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b9:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487622:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a1ea4ee/0xb4bb873a1913adf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bec0bd expref: 16 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487636:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b8:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487643:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aaf84ba/0xb4bb873a1913ac84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebfd6 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487677:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b7:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487686:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0afb50a/0xb4bb873a1913ab50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebf66 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487715:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487723:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000823e52fe/0xb4bb873a1913a9dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebeb0 expref: 13 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487739:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487746:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095523872/0xb4bb873a1913a894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebe08 expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487761:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487768:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a04e8703/0xb4bb873a1913a74b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebd91 expref: 11 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487783:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487801:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4d986b/0xb4bb873a1913a5ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebce2 expref: 10 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690396.487842:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1b2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1779690396.487849:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4b4a5c/0xb4bb873a1913a4a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bebc3a expref: 9 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690396.487866:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9943e8/0xb4bb873a1913193e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750be80c8 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690396.487895:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a191315b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750be7f9b expref: 7 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690396.487906:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690396.490078:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+6:2391:x1866137503594752:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2656us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690396.490090:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18651 00010000:00010000:0.0:1779690397.129085:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690397.246050:0:63590:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 220A: Changelog for archive =========== 02:26:35 (1779690395) 00000100:00100000:2.0:1779690397.508527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.508707:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595008 00000100:00100000:1.0:1779690397.508716:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595008 00000100:00100000:1.0:1779690397.508866:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 396 00000100:00100000:1.0:1779690397.508878:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:100987:x1866137503595008:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690397.508902:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690397.508921:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e2ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda01 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.508985:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.508999:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509027:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509042:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509049:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509054:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509461:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e303 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509470:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509477:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690397.509487:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1779690397.509648:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509656:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509662:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509668:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.509677:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509685:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509697:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:1.0:1779690397.509699:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.509704:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509710:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e2f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509724:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509730:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509736:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509741:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.509744:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509749:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509756:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f903c9800) 00010000:00010000:1.0:1779690397.509759:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.509767:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.509772:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e2fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.510160:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e2ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda01 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.510176:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e303 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda01 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.510184:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690397.510186:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.510189:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9000, rc 0) 00000100:00100000:1.0:1779690397.510253:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:100987:x1866137503595008:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1734us total) trans 12884902088 rc 0/0 00000100:00100000:1.0:1779690397.510261:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 396 00000100:00080000:3.0:1779690397.521960:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690397.522235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.522318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.522385:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595136 00000100:00100000:1.0:1779690397.522395:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595136 00000100:00100000:1.0:1779690397.522456:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 397 00000100:00100000:1.0:1779690397.522467:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100987:x1866137503595136:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1779690397.522567:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100987:x1866137503595136:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 102us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.522574:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 397 00000100:00100000:3.0:1779690397.522894:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595264 00000100:00100000:3.0:1779690397.522899:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595264 00000100:00100000:3.0:1779690397.522935:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18652 00000100:00100000:3.0:1779690397.522942:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+38:2389:x1866137503595264:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690397.522953:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690397.522976:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e303 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda01 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.522995:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690397.523000:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690397.523036:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+37:2389:x1866137503595264:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 95us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690397.523058:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18652 00000040:00080000:2.0:1779690397.524263:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690397.524270:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690397.527104:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:2.0:1779690397.527122:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690397.535393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.535466:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595392 00000100:00100000:1.0:1779690397.535480:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595392 00000100:00080000:3.0:1779690397.535547:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690397.535573:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 398 00000100:00100000:1.0:1779690397.535611:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:100988:x1866137503595392:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690397.535632:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690397.535651:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda08 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535711:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535725:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535737:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535750:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535757:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.535763:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536350:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536358:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536364:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536379:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.536383:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536390:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536403:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690397.536406:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.536411:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536417:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536430:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536436:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536441:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536445:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.536448:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536453:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536470:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2af1cf28 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690397.536472:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.536475:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536481:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e31f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536515:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e311 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda08 expref: 32 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536525:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690397.536527:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.536531:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda08 expref: 32 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.536541:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8600, rc 0) 00000100:00100000:1.0:1779690397.536951:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:100988:x1866137503595392:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1285us (1502us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690397.536961:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 398 00000100:00100000:0.0:1779690397.547691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.547847:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595648 00000100:00100000:1.0:1779690397.547860:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595648 00000100:00100000:1.0:1779690397.547918:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 399 00000100:00100000:1.0:1779690397.547928:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+31:100988:x1866137503595648:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:1.0:1779690397.547996:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690397.548033:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed9c2 expref: 31 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.548074:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690397.548081:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690397.549015:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.549038:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.549048:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.549091:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.549107:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 36 pid: 57585 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690397.549122:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492304128:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690397.551645:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1779690397.568704:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.570096:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492304128:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690397.570136:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690397.570375:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595776 00000100:00100000:3.0:1779690397.570384:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595776 00010000:00010000:3.0:1779690397.570438:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 37 pid: 57585 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690397.570485:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3215 00000100:00100000:3.0:1779690397.570496:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+37:2391:x1866137503595776:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690397.570515:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690397.570522:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 37 pid: 57585 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570536:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 37 pid: 57585 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570563:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e197 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed998 expref: 37 pid: 57585 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570581:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:3.0:1779690397.570585:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570594:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570603:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.570661:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690397.570689:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.570705:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.570735:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690397.570745:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+36:2391:x1866137503595776:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 248us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690397.570754:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3215 00010000:00010000:1.0:1779690397.570769:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.570791:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690397.575297:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x79:0x0]: returning size 512 00010000:00010000:1.0:1779690397.575315:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575325:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575334:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575343:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.575348:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575355:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575374:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:1.0:1779690397.575378:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.575383:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.575389:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e326 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690397.575433:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000967afb93 reply state 00000000a4a51721 transno 12884902089 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690397.575442:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690397.575656:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+32:100988:x1866137503595648:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 27717us (27966us total) trans 12884902089 rc 0/0 00000100:00100000:2.0:1779690397.575669:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 399 00010000:00010000:3.0:1779690397.580652:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580670:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580677:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580683:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690397.580696:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580704:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580720:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2af1cf28 (ffff9e2f903c9800) 00010000:00010000:3.0:1779690397.580723:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690397.580728:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.580734:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e32d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690397.583184:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.583666:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503595904 00000100:00100000:1.0:1779690397.583781:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503595904 00000100:00100000:1.0:1779690397.584075:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 400 00000100:00100000:1.0:1779690397.584083:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+31:100989:x1866137503595904:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690397.584101:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690397.584118:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda0f expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584169:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584179:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584188:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690397.584345:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:1.0:1779690397.584348:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 100 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690397.584369:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584387:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda0f expref: 33 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584415:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda0f expref: 32 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.584421:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690397.584423:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690397.584426:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690397.584466:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+32:100989:x1866137503595904:12345-192.168.203.5@tcp:101:bash.0 Request processed in 385us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.584470:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 400 00000100:00100000:1.0:1779690397.588585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.592359:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596032 00000100:00100000:0.0:1779690397.592381:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596032 00000100:00100000:2.0:1779690397.592654:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 401 00000100:00100000:2.0:1779690397.592668:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+32:100989:x1866137503596032:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690397.592695:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690397.592722:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda16 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592836:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592855:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592888:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592909:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592917:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.592924:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593080:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ea00/0xb4bb873a1913e357 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593094:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ea00/0xb4bb873a1913e357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593101:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ea00/0xb4bb873a1913e357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690397.593137:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x79:0x0]: returning size 512 00000004:00200000:2.0:1779690397.593141:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690397.593251:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ea00/0xb4bb873a1913e357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593266:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593274:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593292:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593298:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.593303:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593311:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593323:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690397.593326:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.593331:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593337:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593397:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593404:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593411:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593416:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.593419:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593433:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593440:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2af1cf28 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690397.593442:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.593444:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593449:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e350 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593483:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda16 expref: 34 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593496:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ea00/0xb4bb873a1913e357 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda16 expref: 33 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.593504:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.593506:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690397.593508:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ea00, rc 0) 00000100:00100000:2.0:1779690397.593803:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+33:100989:x1866137503596032:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1137us (5222us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.593850:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 401 00000100:00100000:3.0:1779690397.597160:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.598125:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596160 00000100:00100000:2.0:1779690397.598142:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596160 00000100:00100000:2.0:1779690397.598267:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 402 00000100:00100000:2.0:1779690397.598280:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+33:100989:x1866137503596160:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690397.598332:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690397.598360:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e35e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda1d expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598445:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598474:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598489:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598506:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598513:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598520:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598622:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598631:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598638:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598644:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fe00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.598655:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598664:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598678:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.598683:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.598688:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598694:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e365 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598722:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598729:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598736:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598741:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.598744:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598751:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598758:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690397.598760:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.598768:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598786:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e36c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598850:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e35e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda1d expref: 34 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.598862:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.599129:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.599136:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e35e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda1d expref: 34 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.599147:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ee00, rc 0) 00000100:00100000:2.0:1779690397.599244:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+33:100989:x1866137503596160:12345-192.168.203.5@tcp:101:bash.0 Request processed in 967us (2097us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690397.599253:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 402 00000100:00100000:3.0:1779690397.609618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.609727:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596288 00000100:00100000:0.0:1779690397.609740:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596288 00000100:00100000:0.0:1779690397.609845:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 403 00000100:00100000:0.0:1779690397.609857:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:100990:x1866137503596288:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690397.609885:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690397.609910:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda24 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610001:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610020:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610034:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690397.610111:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:0.0:1779690397.610115:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 100 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690397.610145:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610170:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610192:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.610201:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:0.0:1779690397.610204:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690397.610208:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483da00, rc 0) 00000100:00100000:0.0:1779690397.610289:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:100990:x1866137503596288:12345-192.168.203.5@tcp:101:rm.0 Request processed in 434us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690397.610298:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 403 00000100:00100000:3.0:1779690397.614071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690397.614405:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596416 00000100:00100000:1.0:1779690397.614419:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596416 00000100:00100000:1.0:1779690397.614492:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 404 00000100:00100000:1.0:1779690397.614504:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:100990:x1866137503596416:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690397.614529:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690397.614553:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda2b expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614704:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614733:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614748:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614801:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614833:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.614841:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615138:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e396 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615148:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615155:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690397.615194:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x79:0x0]: returning size 512 00000004:00200000:1.0:1779690397.615199:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690397.615226:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615239:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615246:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615253:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615271:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.615277:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615285:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615299:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690397.615302:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.615307:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615313:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615335:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615341:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615347:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615352:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690397.615354:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615360:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615379:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2af1cf28 (ffff9e2f903c9400) 00010000:00010000:1.0:1779690397.615382:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690397.615385:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615390:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e38f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2af1cf28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615427:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda2b expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615443:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9c00/0xb4bb873a1913e396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda2b expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690397.615451:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:1.0:1779690397.615453:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690397.615456:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9c00, rc 0) 00000100:00100000:1.0:1779690397.615538:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:100990:x1866137503596416:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1036us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.615546:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 404 00000100:00100000:1.0:1779690397.622432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.622617:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596544 00000100:00100000:0.0:1779690397.622631:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596544 00000100:00100000:0.0:1779690397.622718:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 405 00000100:00100000:0.0:1779690397.622730:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100990:x1866137503596544:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690397.622755:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690397.622791:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e39d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda32 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622907:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622925:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622939:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622957:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622964:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.622971:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623255:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623263:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623271:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623290:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690397.623295:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623304:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623319:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:0.0:1779690397.623322:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.623329:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623336:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623419:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623427:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623433:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623438:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690397.623441:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623448:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623468:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e308bf54800) 00010000:00010000:0.0:1779690397.623471:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.623474:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623480:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623521:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e39d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda32 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623533:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:0.0:1779690397.623535:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.623539:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e39d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda32 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.623549:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:2.0:1779690397.624547:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100990:x1866137503596544:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1814us (2125us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690397.624568:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 405 00000100:00100000:3.0:1779690397.632178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.633299:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596672 00000100:00100000:2.0:1779690397.633316:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596672 00000100:00100000:2.0:1779690397.633403:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 406 00000100:00100000:2.0:1779690397.633416:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:100990:x1866137503596672:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690397.633444:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690397.633469:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda39 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633565:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633581:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633592:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633607:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633613:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633620:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633708:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633716:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633721:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633727:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fe00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.633731:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633751:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633766:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.633769:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.633785:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633792:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633862:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633870:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633874:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633879:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.633881:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633886:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633894:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690397.633896:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.633899:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633912:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633953:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3b2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda39 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633964:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.633966:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.633970:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda39 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.633980:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690397.637151:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:100990:x1866137503596672:12345-192.168.203.5@tcp:101:rm.0 Request processed in 3723us (4972us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690397.637166:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 406 00000100:00100000:1.0:1779690397.642299:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492304384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690397.642389:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642459:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492304896:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642486:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642514:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1779690397.642519:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492304512:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642576:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642593:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492305024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642615:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642641:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492304640:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642663:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642680:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1779690397.642686:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492304256:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642783:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642833:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492304768:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.642853:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690397.642885:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304384 00000100:00100000:1.0:1779690397.642894:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304384 00000100:00100000:1.0:1779690397.643065:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1779690397.643075:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492304384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690397.643121:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742850560 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690397.643225:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492304384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.643233:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1779690397.643262:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304896 00000100:00100000:1.0:1779690397.643266:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304896 00000100:00100000:0.0:1779690397.643391:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304256 00000100:00100000:0.0:1779690397.643397:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304256 00000100:00100000:2.0:1779690397.643427:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304512 00000100:00100000:0.0:1779690397.643432:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1779690397.643434:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304512 00000100:00100000:0.0:1779690397.643440:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492304256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690397.643478:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492305024 00000100:00100000:0.0:1779690397.643479:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492304256:12345-0@lo:400:kworker.0 Request processed in 40us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.643483:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492305024 00000100:00100000:0.0:1779690397.643491:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1779690397.643501:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304640 00000100:00100000:2.0:1779690397.643505:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304640 00000100:00100000:2.0:1779690397.643529:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1779690397.643537:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492304512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690397.643538:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492305152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690397.643581:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690397.643598:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492304512:12345-0@lo:400:kworker.0 Request processed in 61us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.643606:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1779690397.643622:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492304256:0@lo:400:kworker.0 00000100:00100000:2.0:1779690397.643625:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1779690397.643646:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690397.643673:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492305152 00000100:00100000:0.0:1779690397.643681:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492305152 00000100:00100000:2.0:1779690397.643683:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492305024:12345-0@lo:400:kworker.0 Request processed in 40us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.643691:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1779690397.643709:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1779690397.643713:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1779690397.643720:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492304640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690397.643724:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492305152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690397.643748:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690397.643761:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492304640:12345-0@lo:400:kworker.0 Request processed in 42us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.643767:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1779690397.643792:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492305152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690397.643798:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1779690397.643855:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492305152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690397.643868:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492304640:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.644223:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492304768 00000100:00100000:1.0:1779690397.644227:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492304768 00000100:00100000:1.0:1779690397.644261:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:1.0:1779690397.644268:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.644430:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492304896:12345-0@lo:400:kworker.0 Request processed in 163us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.644453:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:1.0:1779690397.644465:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1779690397.644470:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492304768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.644499:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492304768:12345-0@lo:400:kworker.0 Request processed in 29us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690397.644505:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00080000:1.0:1779690397.644530:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690397.644535:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690397.644537:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690397.644612:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492304512:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.644625:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492305024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690397.644633:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968339 gen 2 00000004:00080000:1.0:1779690397.644638:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e308658bb80, transno 4294968339 00000100:00100000:1.0:1779690397.644657:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492304384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690397.644666:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492304896:0@lo:400:kworker.0 00000100:00100000:0.0:1779690397.644734:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492304768:0@lo:400:kworker.0 00000100:00100000:2.0:1779690397.649742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690397.650657:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596800 00000100:00100000:0.0:1779690397.650671:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596800 00000100:00100000:0.0:1779690397.650739:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 407 00000100:00100000:0.0:1779690397.650748:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100991:x1866137503596800:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690397.650783:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690397.650829:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e3c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda40 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.650911:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.650931:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.650944:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651039:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651047:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651054:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651128:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651136:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651144:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651150:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690397.651155:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651163:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651175:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:0.0:1779690397.651178:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.651182:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651189:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e3ce lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651210:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651216:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651222:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651227:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690397.651230:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651235:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651242:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e308bf54800) 00010000:00010000:0.0:1779690397.651244:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.651246:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651251:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e3d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651282:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e3c7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda40 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.651292:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:0.0:1779690397.651294:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690397.652090:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e3c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda40 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690397.652108:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:0.0:1779690397.652260:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:100991:x1866137503596800:12345-192.168.203.5@tcp:101:cp.0 Request processed in 1511us (2529us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690397.652269:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 407 00000100:00100000:1.0:1779690397.662672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.662867:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503596928 00000100:00100000:2.0:1779690397.662889:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503596928 00000100:00100000:2.0:1779690397.663064:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 408 00000100:00100000:2.0:1779690397.663077:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:100991:x1866137503596928:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690397.663103:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690397.663128:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3dc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda47 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663213:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663300:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663317:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663335:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663360:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663367:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663447:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663455:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663462:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663468:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.663473:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663479:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663492:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.663495:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.663501:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663507:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e3e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663522:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663535:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663541:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663546:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fe00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.663549:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663680:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663690:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690397.663693:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.663696:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663702:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e3ea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663743:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3dc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda47 expref: 39 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663755:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.663757:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.663761:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e3dc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda47 expref: 39 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.663795:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690397.664410:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:100991:x1866137503596928:12345-192.168.203.5@tcp:101:cp.0 Request processed in 1333us (1748us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690397.664420:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 408 00000100:00100000:3.0:1779690397.667484:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.670005:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597184 00000100:00100000:2.0:1779690397.670018:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597184 00000100:00100000:2.0:1779690397.670091:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 409 00000100:00100000:2.0:1779690397.670248:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:100991:x1866137503597184:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690397.670271:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690397.670291:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e3f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda4e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670418:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670432:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670443:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670527:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670536:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.670543:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690397.671939:0:57559:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e9:0x0], index 0: 0 00010000:00010000:2.0:1779690397.672124:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e406 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672137:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e406 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672147:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e406 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672178:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672184:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672190:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672195:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690397.672199:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672206:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672217:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690397.672220:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690397.672225:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672242:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e3f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690397.672256:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007dbab967 reply state 000000009d104201 transno 12884902090 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690397.672266:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690397.672300:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e3f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda4e expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672314:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f000/0xb4bb873a1913e406 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda4e expref: 40 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.672321:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:2.0:1779690397.672323:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690397.672325:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f000, rc 0) 00000100:00100000:2.0:1779690397.672401:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:100991:x1866137503597184:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2301us (4928us total) trans 12884902090 rc 0/0 00000100:00100000:2.0:1779690397.672408:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 409 00010000:00010000:3.0:1779690397.676095:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676117:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676126:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676133:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690397.676139:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676149:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676171:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690397.676175:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690397.676182:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.676190:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e3ff lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690397.676622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690397.677979:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597312 00000100:00100000:3.0:1779690397.677989:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597312 00000100:00100000:3.0:1779690397.678075:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6383 00000100:00100000:3.0:1779690397.678084:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+6:2392:x1866137503597312:12345-192.168.203.5@tcp:101:cp.0 00000100:00080000:1.0:1779690397.678417:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690397.678469:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690397.678491:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda55 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690397.678517:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690397.678534:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690397.678535:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690397.678543:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 7 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.678559:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 7 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.678570:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e000, rc 0) 00000100:00100000:3.0:1779690397.678634:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503597312:12345-192.168.203.5@tcp:101:cp.0 Request processed in 551us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690397.678641:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6383 00000100:00100000:1.0:1779690397.683591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690397.684330:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597440 00000100:00100000:3.0:1779690397.684339:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597440 00000100:00100000:3.0:1779690397.684396:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6384 00000100:00100000:3.0:1779690397.684405:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+7:100991:x1866137503597440:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690397.684421:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690397.684438:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda5c expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.684468:0:10273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.684490:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690397.684492:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690397.684498:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.684530:0:10273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.684542:0:10273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 8 pid: 22747 timeout: 3225 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690397.684556:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492305280:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690397.684639:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3091c03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690397.687092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.687344:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597568 00000100:00100000:2.0:1779690397.687352:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597568 00010000:00010000:2.0:1779690397.687385:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 9 pid: 22747 timeout: 3225 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690397.687422:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3216 00000100:00100000:2.0:1779690397.687431:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503597568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690397.687452:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690397.687475:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 9 pid: 22747 timeout: 3225 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.687496:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 9 pid: 22747 timeout: 3225 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.687522:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690397.687524:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690397.687530:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.687540:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690397.687578:0:7464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690397.687592:0:7464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7464:1866137492305408:192.168.203.5@tcp:105: 00000100:00100000:2.0:1779690397.687673:0:7464:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30b47d2f00 going to sleep for 11 seconds 00010000:00010000:3.0:1779690397.687862:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e414 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda55 expref: 9 pid: 22747 timeout: 3225 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690397.687877:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492305280:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690397.687902:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690397.687913:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00100000:3.0:1779690397.687943:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+8:100991:x1866137503597440:12345-192.168.203.5@tcp:101:cp.0 Request processed in 3539us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690397.687950:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6384 00000100:00100000:3.0:1779690397.690410:0:7464:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7464:1866137492305408:192.168.203.5@tcp:105: 00010000:00010000:3.0:1779690397.690435:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690397.690596:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503597568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3164us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690397.690615:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3216 00000100:00100000:1.0:1779690397.691452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690397.691544:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597824 00000100:00100000:2.0:1779690397.691552:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597824 00000100:00100000:2.0:1779690397.691623:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:2.0:1779690397.691644:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+40:100991:x1866137503597824:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:2.0:1779690397.692011:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+41:100991:x1866137503597824:12345-192.168.203.5@tcp:35:cp.0 Request processed in 367us (560us total) trans 12884902091 rc 0/0 00000100:00100000:2.0:1779690397.692019:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00010000:00010000:2.0:1779690398.153579:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690399.182977:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690399.290538:0:63687:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000001:00080000:2.0:1779690399.735384:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902089 is committed 00000001:00080000:2.0:1779690399.735408:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902088 is committed 00000001:00080000:2.0:1779690399.735420:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902091 is committed 00000020:00000080:0.0:1779690399.939573:0:63740:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc5eaa29b0 00000004:00000080:0.0:1779690399.939594:0:63740:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e3082eea000 uarg=0000000000000000 00000004:00000080:0.0:1779690399.939648:0:63740:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e3082eea000 00000040:00080000:0.0:1779690399.940669:0:63740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1779690399.941562:0:63740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1779690399.941712:0:63740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].1, 80 off8272 00000004:00000080:0.0:1779690399.941775:0:63740:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:0.0:1779690399.941781:0:63740:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690400.034361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.034470:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503597952 00000100:00100000:2.0:1779690400.034484:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503597952 00000100:00080000:1.0:1779690400.034541:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690400.034578:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 410 00000100:00100000:2.0:1779690400.034591:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+32:101031:x1866137503597952:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690400.034619:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690400.034650:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e422 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda63 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034732:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034765:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034780:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034796:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034849:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.034858:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035270:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035280:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035288:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690400.035330:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x14:0x0]: returning size 1516 00000004:00200000:2.0:1779690400.035335:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690400.035357:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035369:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035379:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035386:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035393:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035411:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690400.035416:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035425:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035438:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690400.035441:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690400.035447:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035453:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e429 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035464:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035470:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035475:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035480:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690400.035483:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035489:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035509:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0xa21598b6 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690400.035512:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690400.035515:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035520:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e430 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0xa21598b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035556:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e422 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda63 expref: 34 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035571:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e400/0xb4bb873a1913e437 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda63 expref: 33 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.035578:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:2.0:1779690400.035581:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690400.035583:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e400, rc 0) 00000100:00100000:2.0:1779690400.035669:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+33:101031:x1866137503597952:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1081us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.035679:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 410 00000100:00100000:2.0:1779690400.041194:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690400.041288:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598080 00000100:00100000:3.0:1779690400.041301:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598080 00000100:00100000:3.0:1779690400.041380:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6385 00000100:00100000:3.0:1779690400.041394:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503598080:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690400.041418:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690400.041440:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e43e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda6a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690400.041521:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492305536:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690400.041646:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8d8bb240 going to sleep for 11 seconds 00000100:00080000:1.0:1779690400.041822:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1779690400.043902:0:6582:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1e9:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1779690400.043924:0:6582:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1e9:0x0] updating lvb mtime: 0 -> 1779690397 00002000:00010000:3.0:1779690400.043927:0:6582:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x240000400:0x1e9:0x0] updating lvb atime: 0 -> 1779690397 00002000:00010000:3.0:1779690400.043930:0:6582:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1e9:0x0] updating lvb ctime: 0 -> 1779690397 00000100:00100000:3.0:1779690400.043961:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492305536:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690400.044017:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e43e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda6a expref: 17 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.044048:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e43e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda6a expref: 17 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.044064:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53ee00, rc 0) 00000100:00100000:3.0:1779690400.044148:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503598080:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2755us (2962us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690400.044170:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6385 00000100:00100000:3.0:1779690400.047667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.047796:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598208 00000100:00100000:2.0:1779690400.047846:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598208 00000100:00100000:2.0:1779690400.047917:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 411 00000100:00100000:2.0:1779690400.047928:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+33:101031:x1866137503598208:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690400.047955:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690400.047980:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda71 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048077:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e44c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048095:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048109:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690400.048348:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x79:0x0]: returning size 7680 00000004:00200000:2.0:1779690400.048353:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690400.048429:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048462:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda71 expref: 35 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048481:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ee00/0xb4bb873a1913e44c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda71 expref: 34 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.048490:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x79:0x0].0x0 (ffff9e2f826ec200) 00010000:00010000:2.0:1779690400.048493:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690400.048498:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ee00, rc 0) 00000100:00100000:2.0:1779690400.048573:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+34:101031:x1866137503598208:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 646us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.048581:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 411 00000100:00100000:1.0:1779690400.051899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.052015:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598336 00000100:00100000:2.0:1779690400.052029:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598336 00000100:00100000:2.0:1779690400.052114:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6386 00000100:00100000:2.0:1779690400.052126:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2391:x1866137503598336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690400.052150:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690400.052173:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c9db9/0xb4bb873a1913e453 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda78 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690400.052259:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1866137492305664:192.168.203.5@tcp:106: 00000100:00100000:2.0:1779690400.052370:0:6583:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381180 going to sleep for 11 seconds 00000100:00100000:3.0:1779690400.057195:0:6583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1866137492305664:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690400.057245:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c9db9/0xb4bb873a1913e453 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda78 expref: 17 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.057277:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c9db9/0xb4bb873a1913e453 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda78 expref: 17 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.057290:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fe00, rc 0) 00000100:00100000:3.0:1779690400.057368:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2391:x1866137503598336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 5242us (5477us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690400.057378:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6386 00000100:00100000:0.0:1779690400.066919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.067040:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598592 00000100:00100000:2.0:1779690400.067053:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598592 00000100:00100000:2.0:1779690400.067123:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 412 00000100:00100000:2.0:1779690400.067135:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+34:101031:x1866137503598592:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690400.067488:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].20, 136 off10912 00000100:00100000:2.0:1779690400.067606:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+34:101031:x1866137503598592:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 472us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.067615:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 412 00010000:00010000:3.0:1779690400.218154:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690400.218594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.218672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.218694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.218724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.218776:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.218830:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598976 00000100:00100000:1.0:1779690400.218843:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598976 00000100:00100000:1.0:1779690400.218917:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599232 00000100:00100000:1.0:1779690400.218921:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599232 00000100:00100000:1.0:1779690400.218948:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599104 00000100:00100000:1.0:1779690400.218952:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599104 00000100:00100000:1.0:1779690400.218987:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2806 00000100:00100000:1.0:1779690400.218999:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503598976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690400.219098:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503598976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.219110:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2806 00000100:00100000:1.0:1779690400.219135:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2807 00000100:00100000:1.0:1779690400.219142:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503599232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690400.219174:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503599232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.219181:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2807 00000100:00100000:1.0:1779690400.219197:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2808 00000100:00100000:1.0:1779690400.219206:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503599104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690400.219234:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503599104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.219241:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2808 00000100:00080000:1.0:1779690400.219260:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690400.219276:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690400.219777:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598720 00000100:00100000:3.0:1779690400.219785:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598720 00000100:00100000:3.0:1779690400.219907:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:3.0:1779690400.219916:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503598720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690400.219970:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503598720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 55us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690400.219976:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:3.0:1779690400.220033:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503598848 00000100:00100000:3.0:1779690400.220038:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503598848 00000100:00100000:3.0:1779690400.220085:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:3.0:1779690400.220096:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+34:2392:x1866137503598848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1779690400.220168:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690400.221822:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+34:2392:x1866137503598848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 63us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690400.221851:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000040:00080000:3.0:1779690400.585452:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690400.585465:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690400.585701:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 21 count 14 00000040:00080000:3.0:1779690400.585710:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690400.586339:0:57595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1779690400.588092:0:57595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00000100:00100000:3.0:1779690400.588296:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492305792:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690400.588411:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30812ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690400.592141:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492305792:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690400.593529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.593629:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599360 00000100:00100000:1.0:1779690400.593640:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599360 00000100:00100000:1.0:1779690400.593760:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 413 00000100:00100000:1.0:1779690400.593772:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+34:101041:x1866137503599360:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690400.593840:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x14:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690400.593981:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+34:101041:x1866137503599360:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 211us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.593997:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 413 00000100:00100000:2.0:1779690400.599007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.599186:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599616 00000100:00100000:0.0:1779690400.599200:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599616 00000100:00100000:0.0:1779690400.599274:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 414 00000100:00100000:0.0:1779690400.599285:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:101041:x1866137503599616:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690400.599312:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690400.599339:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913e45a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda7f expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.599466:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e461 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.599484:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.599514:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690400.599528:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x14:0x0]: returning size 1516 00010000:00010000:0.0:1779690400.599715:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483dc00/0xb4bb873a1913e45a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda7f expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.599738:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e461 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda7f expref: 36 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.599758:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:0.0:1779690400.599762:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690400.599768:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690400.600284:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101041:x1866137503599616:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 997us (1298us total) trans 12884902092 rc 0/0 00000100:00100000:0.0:1779690400.600293:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 414 00000100:00100000:2.0:1779690400.604561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.604627:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599744 00000100:00100000:2.0:1779690400.604629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.604639:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599744 00000100:00100000:1.0:1779690400.604727:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18653 00000100:00100000:1.0:1779690400.604738:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+36:2389:x1866137503599744:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690400.604767:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690400.604799:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e461 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda7f expref: 36 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.604862:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:1.0:1779690400.604868:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690400.604937:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+35:2389:x1866137503599744:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 201us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.604945:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18653 00000100:00100000:3.0:1779690400.605134:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503599872 00000100:00100000:3.0:1779690400.605139:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503599872 00000100:00100000:3.0:1779690400.605184:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6387 00000100:00100000:3.0:1779690400.605193:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503599872:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690400.605236:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.605258:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 7 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.605266:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690400.605268:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690400.605272:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.606199:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 7 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690400.606217:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 7 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690400.606235:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492305920:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690400.606320:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30812ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690400.609864:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492305920:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690400.609902:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690400.612203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.612885:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600000 00000100:00100000:1.0:1779690400.612901:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600000 00002000:00100000:1.0:1779690400.612967:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x1e9:0x0] (0->1515) req@ffff9e2f95df1f80 x1866137503600000/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:636/0 lens 2008/0 e 0 to 0 dl 1779690411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690400.612980:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95df1f80 with x1866137503600000 ext(0->1515) 00010000:00010000:1.0:1779690400.612997:0:37636:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 8 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.613017:0:37636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 8 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690400.613026:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f95df1f80 00000100:00100000:1.0:1779690400.613064:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:1.0:1779690400.613075:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503600000:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:1.0:1779690400.614339:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503600000:12345-192.168.203.5@tcp:4:cp.0 Request processed in 1259us (2139us total) trans 4294968340 rc 0/0 00000100:00100000:1.0:1779690400.614351:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00002000:00100000:1.0:1779690400.614362:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x1e9:0x0] (0->1515) req@ffff9e2f95df1f80 x1866137503600000/t4294968340(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:636/0 lens 2008/448 e 0 to 0 dl 1779690411 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690400.614372:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95df1f80 with x1866137503600000 ext(0->1515) 00010000:00010000:1.0:1779690400.614380:0:37636:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.614398:0:37636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690400.614407:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f95df1f80 00000100:00100000:2.0:1779690400.623346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.625853:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600128 00000100:00100000:0.0:1779690400.625865:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600128 00010000:00010000:0.0:1779690400.626046:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690400.626088:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3217 00000100:00100000:0.0:1779690400.626099:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503600128:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690400.626113:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690400.626132:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.626160:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.626182:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a9a751/0xb4bb873a1913e41b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda5c expref: 10 pid: 10273 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.626196:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.626198:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.626202:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.626257:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.626297:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690400.626359:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503600128:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 262us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.626366:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3217 00010000:00010000:2.0:1779690400.626437:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626447:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626476:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626485:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626492:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626499:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690400.626502:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626510:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626522:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.626529:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f0061b/0xb4bb873a1913e46f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690400.626601:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2389:x1866137503599872:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 21409us (21970us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.626618:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6387 00000100:00100000:1.0:1779690400.631779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.631860:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600384 00000100:00100000:1.0:1779690400.631873:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600384 00000100:00100000:1.0:1779690400.631937:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 415 00000100:00100000:1.0:1779690400.631959:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101041:x1866137503600384:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690400.632095:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101041:x1866137503600384:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.632104:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 415 00000100:00100000:3.0:1779690400.638488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.638861:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600512 00000100:00100000:0.0:1779690400.638873:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600512 00000100:00100000:0.0:1779690400.639035:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6388 00000100:00100000:0.0:1779690400.639050:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503600512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690400.639068:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690400.639089:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d18503/0xb4bb873a1913e476 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda86 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690400.639130:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e9:0x0] initial LVB size: 1516, mtime: 0x6a13eb9d, atime: 0x0, ctime: 0x6a13eb9d, blocks: 0x1 00010000:00010000:0.0:1779690400.639151:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.639153:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.639162:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d18503/0xb4bb873a1913e476 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda86 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.639180:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095d18503/0xb4bb873a1913e476 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda86 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.639193:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483dc00, rc 0) 00000100:00100000:0.0:1779690400.639314:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503600512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 267us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.639322:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6388 00000100:00100000:1.0:1779690400.642831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.643325:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600768 00000100:00100000:0.0:1779690400.643336:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600768 00000100:00100000:0.0:1779690400.643391:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 416 00000100:00100000:0.0:1779690400.643402:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:101041:x1866137503600768:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690400.643508:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:101041:x1866137503600768:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 107us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.643515:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 416 00000100:00100000:0.0:1779690400.646540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.648525:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503600896 00000100:00100000:1.0:1779690400.648537:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503600896 00002000:00100000:1.0:1779690400.648603:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1e9:0x0] (0->4095) req@ffff9e2f82409500 x1866137503600896/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:636/0 lens 488/0 e 0 to 0 dl 1779690411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690400.648615:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f82409500 with x1866137503600896 ext(0->4095) 00002000:00010000:1.0:1779690400.648620:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f82409500 00000100:00100000:1.0:1779690400.648654:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2044 00000100:00100000:1.0:1779690400.648663:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503600896:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1779690400.648928:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503600896:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 264us (2393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1779690400.648937:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2044 00002000:00100000:1.0:1779690400.648946:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1e9:0x0] (0->4095) req@ffff9e2f82409500 x1866137503600896/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:636/0 lens 488/4536 e 0 to 0 dl 1779690411 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690400.648955:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f82409500 with x1866137503600896 ext(0->4095) 00002000:00010000:1.0:1779690400.648959:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f82409500 00000100:00100000:3.0:1779690400.655244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.655373:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601024 00000100:00100000:1.0:1779690400.655382:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601024 00000100:00100000:1.0:1779690400.655441:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 417 00000100:00100000:1.0:1779690400.655451:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101041:x1866137503601024:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690400.655478:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690400.655495:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e47d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda8d expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655527:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655540:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655551:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655638:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e47d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 37 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655654:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.655662:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:1.0:1779690400.655664:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690400.655668:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690400.655723:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101041:x1866137503601024:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 273us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.655731:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 417 00000100:00100000:3.0:1779690400.658628:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.661569:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601152 00000100:00100000:0.0:1779690400.661580:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601152 00000100:00100000:1.0:1779690400.662001:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 418 00000100:00100000:1.0:1779690400.662013:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101041:x1866137503601152:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690400.662044:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x14:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690400.662185:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101041:x1866137503601152:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 174us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.662193:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 418 00000100:00100000:3.0:1779690400.665297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.665366:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601280 00000100:00100000:0.0:1779690400.665376:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601280 00000100:00100000:0.0:1779690400.665439:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6389 00000100:00100000:0.0:1779690400.665449:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503601280:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690400.665486:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665502:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.665504:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690400.665519:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665533:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665561:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665568:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665575:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665582:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690400.665586:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665594:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665614:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.665621:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f5ebd56/0xb4bb873a1913e48b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690400.665955:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503601280:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 506us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.665964:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6389 00000100:00100000:3.0:1779690400.673535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.673790:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601536 00000100:00100000:1.0:1779690400.673799:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601536 00000100:00100000:1.0:1779690400.673896:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 419 00000100:00100000:1.0:1779690400.673906:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101041:x1866137503601536:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690400.673972:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.673989:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.673998:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.674029:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690400.674052:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 36 pid: 57585 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690400.674065:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492306048:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690400.674159:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8e8f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1779690400.676786:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492306048:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690400.676829:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690400.677134:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.677221:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601664 00000100:00100000:0.0:1779690400.677227:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601664 00010000:00010000:0.0:1779690400.677260:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 37 pid: 57585 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690400.677302:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3218 00000100:00100000:0.0:1779690400.677312:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+37:2392:x1866137503601664:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690400.677326:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690400.677333:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 37 pid: 57585 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677344:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 37 pid: 57585 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677386:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e484 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda8d expref: 37 pid: 57585 timeout: 3228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677406:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:0.0:1779690400.677414:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677422:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677429:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690400.677459:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690400.677499:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.677509:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690400.677510:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503601664:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 198us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.677526:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3218 00000001:00080000:2.0:1779690400.677915:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902093 00010000:00010000:2.0:1779690400.677940:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678107:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678117:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678124:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690400.678128:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678136:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678146:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x14:0x0].0x0 (ffff9e2f826ecf00) 00010000:00010000:2.0:1779690400.678149:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690400.678152:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690400.678158:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e492 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690400.678479:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:101041:x1866137503601536:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 4574us (4952us total) trans 12884902094 rc 0/0 00000100:00100000:2.0:1779690400.678489:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 419 00000020:00080000:2.0:1779690400.678493:0:57585:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1779690400.678703:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690400.678708:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690400.679318:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 14 00000040:00080000:0.0:1779690400.679327:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690400.682063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690400.682150:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503601920 00000100:00100000:3.0:1779690400.682158:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503601920 00000100:00100000:3.0:1779690400.682332:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:3.0:1779690400.682344:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+37:101041:x1866137503601920:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690400.682566:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101041:x1866137503601920:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 226us (510us total) trans 12884902095 rc 0/0 00000100:00100000:3.0:1779690400.682574:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000040:00080000:0.0:1779690400.735166:0:63789:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690400.735172:0:63789:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690400.735250:0:63789:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 21 count 14 00000040:00080000:0.0:1779690400.735257:0:63789:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690400.784927:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.785059:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602048 00000100:00100000:1.0:1779690400.785067:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602048 00000100:00100000:1.0:1779690400.785110:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 420 00000100:00100000:1.0:1779690400.785120:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602048:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690400.785465:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602048:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 346us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.785473:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 420 00000100:00100000:2.0:1779690400.789351:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690400.789443:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602176 00000100:00100000:3.0:1779690400.789452:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602176 00000100:00100000:3.0:1779690400.789503:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 421 00000100:00100000:3.0:1779690400.789512:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602176:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1779690400.789640:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690400.789707:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602176:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 195us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690400.789714:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 421 00000100:00100000:3.0:1779690400.792278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.792371:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602304 00000100:00100000:2.0:1779690400.792379:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602304 00000100:00100000:2.0:1779690400.792451:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 422 00000100:00100000:2.0:1779690400.792460:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602304:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690400.792572:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690400.792648:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602304:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 189us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.792656:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 422 00000100:00100000:1.0:1779690400.794117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690400.794198:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602432 00000100:00100000:3.0:1779690400.794205:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602432 00000100:00100000:3.0:1779690400.794274:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 423 00000100:00100000:3.0:1779690400.794283:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602432:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690400.794382:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690400.794452:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602432:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 170us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690400.794460:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 423 00000100:00100000:3.0:1779690400.795774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690400.795848:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602560 00000100:00100000:1.0:1779690400.795854:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602560 00000100:00100000:1.0:1779690400.795892:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 424 00000100:00100000:1.0:1779690400.795901:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602560:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690400.795981:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602560:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690400.795989:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 424 00000100:00100000:3.0:1779690400.797555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690400.797730:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602688 00000100:00100000:2.0:1779690400.797737:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602688 00000100:00100000:2.0:1779690400.797788:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 425 00000100:00100000:2.0:1779690400.797797:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602688:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1779690400.798141:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602688:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 344us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690400.798148:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 425 00000100:00100000:3.0:1779690400.800263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690400.800731:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602816 00000100:00100000:0.0:1779690400.800739:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602816 00000100:00100000:0.0:1779690400.800801:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 426 00000100:00100000:0.0:1779690400.800921:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690400.801075:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 151us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690400.801785:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 426 00000100:00100000:2.0:1779690400.804914:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690400.804982:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503602944 00000100:00100000:3.0:1779690400.804990:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503602944 00000100:00100000:3.0:1779690400.805042:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 427 00000100:00100000:3.0:1779690400.805052:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602944:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690400.805217:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:101047:x1866137503602944:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 166us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690400.805231:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 427 00010000:00010000:2.0:1779690401.225520:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690402.249111:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690402.761172:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690402.761180:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690402.761313:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 21 count 13 00000040:00080000:0.0:1779690402.761333:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690402.761409:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690402.761473:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690402.761491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690402.763575:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690402.763653:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492306688:0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.763698:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690402.763736:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1779690402.763743:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492306560:0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.763775:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690402.763794:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492307072:0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.763834:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690402.764287:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306176 00000100:00100000:2.0:1779690402.764295:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306176 00000100:00100000:2.0:1779690402.764362:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306304 00000100:00100000:2.0:1779690402.764366:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306304 00000100:00100000:2.0:1779690402.764384:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1779690402.764393:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690402.764443:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690402.764486:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690402.764494:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1779690402.764511:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1779690402.764518:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492306304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690402.764537:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743899136 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690402.764562:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690402.764570:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492306304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690402.764573:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306816:0@lo:400:kworker.0 00000100:00100000:2.0:1779690402.764581:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00080000:2.0:1779690402.764600:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690402.764605:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690402.764612:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690402.764671:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1779690402.764679:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492306432:0@lo:400:kworker.0 00000100:00100000:0.0:1779690402.764707:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690402.764745:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306944:0@lo:400:kworker.0 00000100:00100000:0.0:1779690402.764767:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690402.765867:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690402.765918:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306688 00000100:00100000:3.0:1779690402.765924:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306688 00000100:00100000:3.0:1779690402.765974:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306560 00000100:00100000:3.0:1779690402.765978:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306560 00000100:00100000:3.0:1779690402.765991:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492307072 00000100:00100000:3.0:1779690402.765993:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492307072 00000100:00100000:3.0:1779690402.766007:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1779690402.766013:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492306688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.766065:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492306688:12345-0@lo:400:kworker.0 Request processed in 52us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690402.766072:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1779690402.766089:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1779690402.766094:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492306560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.766121:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492306560:12345-0@lo:400:kworker.0 Request processed in 27us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690402.766134:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1779690402.766147:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1779690402.766152:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492307072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.766308:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492307072:12345-0@lo:400:kworker.0 Request processed in 155us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690402.766315:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1779690402.766414:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690402.767013:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306816 00000100:00100000:2.0:1779690402.767020:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306816 00000100:00100000:0.0:1779690402.767033:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306432 00000100:00100000:0.0:1779690402.767039:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306432 00000100:00100000:2.0:1779690402.767067:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492306944 00000100:00100000:2.0:1779690402.767071:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492306944 00000100:00100000:0.0:1779690402.767080:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1779690402.767091:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492306432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690402.767102:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1779690402.767111:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690402.767146:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492306432:12345-0@lo:400:kworker.0 Request processed in 58us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690402.767166:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1779690402.767229:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306816:12345-0@lo:400:kworker.0 Request processed in 49us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690402.767237:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1779690402.767243:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492306432:0@lo:400:kworker.0 00000100:00100000:2.0:1779690402.767257:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1779690402.767262:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306816:0@lo:400:kworker.0 00000100:00100000:2.0:1779690402.767268:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690402.767325:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492306944:12345-0@lo:400:kworker.0 Request processed in 62us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690402.767332:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1779690402.767530:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492306560:0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.767540:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492307072:0@lo:400:kworker.0 00000100:00100000:3.0:1779690402.767551:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492306688:0@lo:400:kworker.0 00000100:00100000:0.0:1779690402.768070:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492306944:0@lo:400:kworker.0 00010000:00010000:3.0:1779690403.273304:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690404.299267:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690404.851928:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968340 is committed 00000001:00080000:2.0:1779690404.857832:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902092 is committed 00000001:00080000:2.0:1779690404.857953:0:63721:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902094 is committed 00000001:00080000:2.0:1779690404.858117:0:63719:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902095 is committed 00000040:00080000:2.0:1779690404.949956:0:63987:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690404.949962:0:63987:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690404.949999:0:63987:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 2 count 2 00000040:00080000:2.0:1779690404.950005:0:63987:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690404.973287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690404.973327:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603072 00000100:00100000:0.0:1779690404.973337:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603072 00000100:00100000:0.0:1779690404.973398:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 428 00000100:00080000:1.0:1779690404.973405:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690404.973410:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:101486:x1866137503603072:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690404.973452:0:57560:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b398ded0 uarg=0000000000000000 00000004:00000080:0.0:1779690404.973490:0:57560:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b398ded0 00000004:00000080:0.0:1779690404.973496:0:57560:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1779690404.973631:0:57560:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690404.973635:0:57560:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690404.973671:0:57560:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 3 00000040:00080000:0.0:1779690404.973794:0:57560:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 2 count 2 00000040:00080000:0.0:1779690404.973820:0:57560:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690404.973827:0:57560:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1779690404.973871:0:57560:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690404.973874:0:57560:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690404.974398:0:57560:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 3 count 1 00000040:00080000:0.0:1779690404.974402:0:57560:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690404.974488:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:101486:x1866137503603072:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1081us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690404.974494:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 428 00000100:00100000:0.0:1779690405.313966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314036:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314050:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314065:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690405.314115:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603200 00000100:00100000:0.0:1779690405.314124:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603200 00000100:00100000:0.0:1779690405.314170:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:0.0:1779690405.314179:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503603200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690405.314246:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503603200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690405.314254:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:0.0:1779690405.314285:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603328 00000100:00100000:0.0:1779690405.314288:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603328 00000100:00100000:0.0:1779690405.314319:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603840 00000100:00100000:0.0:1779690405.314321:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603840 00000100:00100000:1.0:1779690405.314432:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603456 00000100:00100000:1.0:1779690405.314437:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603456 00000100:00100000:1.0:1779690405.314463:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603712 00000100:00100000:1.0:1779690405.314466:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603712 00000100:00100000:1.0:1779690405.314491:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2811 00000100:00100000:1.0:1779690405.314499:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503603328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690405.314531:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503603328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690405.314537:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2811 00000100:00100000:1.0:1779690405.314549:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2812 00000100:00100000:1.0:1779690405.314556:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503603456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690405.314593:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503603456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690405.314600:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2812 00000100:00100000:1.0:1779690405.314614:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2813 00000100:00100000:1.0:1779690405.314620:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503603712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690405.314640:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503603712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690405.314646:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2813 00000100:00100000:1.0:1779690405.314665:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603584 00000100:00100000:1.0:1779690405.314669:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603584 00000100:00100000:1.0:1779690405.314706:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:1.0:1779690405.314713:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+34:2390:x1866137503603584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690405.314741:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+34:2390:x1866137503603584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690405.314747:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00080000:1.0:1779690405.314766:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690405.314771:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690405.314773:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690405.314997:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2814 00000100:00100000:0.0:1779690405.315005:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503603840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690405.315035:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503603840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690405.315041:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2814 00010000:00010000:2.0:1779690405.321085:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1779690405.545318:0:64036:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fffc319d950 00000004:00000080:3.0:1779690405.545335:0:64036:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e2f95e37400 uarg=0000000000000000 00000004:00000080:3.0:1779690405.545374:0:64036:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e2f95e37400 00000004:00000080:3.0:1779690405.545381:0:64036:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1779690405.545475:0:64036:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690405.545480:0:64036:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1779690405.545512:0:64036:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 3 00000040:00080000:3.0:1779690405.545574:0:64036:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 2 count 2 00000040:00080000:3.0:1779690405.545580:0:64036:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690405.545611:0:64036:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1779690405.545653:0:64036:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690405.545656:0:64036:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1779690405.546565:0:64036:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:3.0:1779690405.546573:0:64036:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1779690405.546603:0:64036:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:3.0:1779690405.546651:0:64036:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690405.546654:0:64036:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690405.546953:0:64036:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 1 count 1 00000040:00080000:3.0:1779690405.546958:0:64036:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690405.546976:0:64036:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1779690405.546978:0:64036:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1779690405.549014:0:64036:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:3.0:1779690405.549107:0:64036:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690405.549111:0:64036:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1779690405.549771:0:64036:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:3.0:1779690405.549780:0:64036:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:3.0:1779690405.550020:0:64036:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690405.550024:0:64036:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690405.550709:0:64036:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690405.550717:0:64036:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:0.0:1779690406.138267:0:64084:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690406.138275:0:64084:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690406.138799:0:64084:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690406.139030:0:64084:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690406.238970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690406.239598:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503603968 00000100:00100000:0.0:1779690406.239615:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503603968 00000100:00100000:0.0:1779690406.239675:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 429 00000100:00100000:0.0:1779690406.239685:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100987:x1866137503603968:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1779690406.239784:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100987:x1866137503603968:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 100us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690406.239791:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 429 00000100:00080000:1.0:1779690406.247879:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690406.251332:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690406.251403:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503604224 00000100:00100000:1.0:1779690406.251412:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503604224 00000100:00100000:1.0:1779690406.251466:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:1.0:1779690406.251477:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+34:100987:x1866137503604224:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690406.251965:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+35:100987:x1866137503604224:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 489us (640us total) trans 12884902096 rc 0/0 00000100:00100000:1.0:1779690406.251983:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00010000:00010000:3.0:1779690406.345139:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690407.369019:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690407.461633:0:64132:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 220a: Changelog for failed archive ==== 02:26:46 (1779690406) 00000100:00100000:0.0:1779690407.649878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.649988:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503604480 00000100:00100000:1.0:1779690407.649998:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503604480 00000100:00100000:1.0:1779690407.650054:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 430 00000100:00100000:1.0:1779690407.650073:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+35:101687:x1866137503604480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690407.650095:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.650113:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e499 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda94 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650219:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650233:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650245:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650257:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650264:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650269:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650693:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e4ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650713:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650720:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690407.650730:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1779690407.650933:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650940:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650947:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650952:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.650956:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650964:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.650975:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:1.0:1779690407.650979:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.650995:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651002:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651015:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651027:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651033:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651037:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.651041:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651046:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651054:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690407.651056:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.651059:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651064:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651382:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e499 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda94 expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651397:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e4ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda94 expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.651404:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690407.651407:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.651413:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690407.651465:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:101687:x1866137503604480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1403us (1698us total) trans 12884902097 rc 0/0 00000100:00100000:1.0:1779690407.651472:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 430 00000100:00100000:3.0:1779690407.658070:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690407.658156:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503604608 00000100:00100000:0.0:1779690407.658165:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503604608 00000100:00100000:0.0:1779690407.658224:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 431 00000100:00100000:0.0:1779690407.658234:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:101687:x1866137503604608:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690407.658340:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:101687:x1866137503604608:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.658347:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 431 00000100:00100000:3.0:1779690407.658856:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690407.659496:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503604736 00000100:00100000:0.0:1779690407.659502:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503604736 00000100:00100000:0.0:1779690407.659643:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18654 00000100:00100000:0.0:1779690407.659653:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+37:2392:x1866137503604736:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690407.659666:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690407.659699:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e4ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda94 expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.659718:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690407.659722:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690407.660006:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503604736:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 138us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.660016:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18654 00000100:00100000:3.0:1779690407.662021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.662299:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503604864 00000100:00100000:1.0:1779690407.662307:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503604864 00000100:00100000:1.0:1779690407.662484:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 432 00000100:00100000:1.0:1779690407.662495:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+34:101688:x1866137503604864:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690407.662513:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.662532:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e4bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beda9b expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662591:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662606:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662616:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662629:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662635:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662641:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662939:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662953:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662959:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662964:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.662968:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662976:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.662988:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690407.662991:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.662995:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663001:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663015:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663021:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663026:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663031:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.663039:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663046:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663054:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48b670e4 (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690407.663056:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.663059:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663065:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663095:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e4bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda9b expref: 35 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663105:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690407.663107:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.663111:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e4bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda9b expref: 35 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.663120:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8600, rc 0) 00000100:00100000:1.0:1779690407.663270:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+34:101688:x1866137503604864:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 776us (1254us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690407.663277:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 432 00000100:00080000:2.0:1779690407.663531:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690407.668446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690407.668579:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605120 00000100:00100000:0.0:1779690407.668589:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605120 00000100:00100000:0.0:1779690407.668637:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 433 00000100:00100000:0.0:1779690407.668646:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+34:101688:x1866137503605120:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690407.668702:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690407.668725:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e33b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda0f expref: 34 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.668745:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:0.0:1779690407.668750:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690407.669045:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.669059:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 35 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.669068:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.669096:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 35 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690407.669108:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 35 pid: 57560 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690407.669122:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3091751c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492307200:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690407.669223:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e309d8c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690407.678742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.678853:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605248 00000100:00100000:1.0:1779690407.678862:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605248 00010000:00010000:1.0:1779690407.678900:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 36 pid: 57560 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690407.678957:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3219 00000100:00100000:1.0:1779690407.678967:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503605248:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690407.678981:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690407.678988:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 36 pid: 57560 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.678998:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 36 pid: 57560 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.679014:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690407.679018:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.679025:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.679030:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.679043:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690407.679091:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503605248:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 127us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.679096:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3219 00010000:00010000:2.0:1779690407.679541:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e37a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beda24 expref: 35 pid: 57560 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690407.679560:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3091751c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492307200:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690407.679580:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.679589:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.679595:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.679618:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.679626:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.679641:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690407.681427:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7a:0x0]: returning size 512 00010000:00010000:2.0:1779690407.681441:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681450:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681457:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681462:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690407.681466:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681473:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681486:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690407.681488:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690407.681492:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.681497:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e4d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690407.681516:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001df30456 reply state 0000000041a0815a transno 12884902098 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690407.681534:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690407.681622:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:101688:x1866137503605120:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 12973us (13181us total) trans 12884902098 rc 0/0 00000100:00100000:2.0:1779690407.681630:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 433 00010000:00010000:3.0:1779690407.682949:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.682962:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.682970:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.682991:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690407.682995:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.683003:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.683016:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48b670e4 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690407.683019:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690407.683023:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.683029:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e4d8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690407.689280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.690339:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605376 00000100:00100000:1.0:1779690407.690349:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605376 00000100:00100000:1.0:1779690407.690410:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 434 00000100:00100000:1.0:1779690407.690421:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+34:101689:x1866137503605376:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690407.690457:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.690477:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedaa2 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.690554:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.690567:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.690578:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690407.690640:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690407.690644:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 101 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690407.690984:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.691008:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e4df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaa2 expref: 36 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.691027:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaa2 expref: 35 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.691103:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690407.691215:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690407.691220:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9800, rc 0) 00000100:00100000:1.0:1779690407.691378:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+35:101689:x1866137503605376:12345-192.168.203.5@tcp:101:bash.0 Request processed in 958us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.691386:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 434 00000100:00100000:0.0:1779690407.693983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.694075:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605504 00000100:00100000:1.0:1779690407.694084:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605504 00000100:00100000:1.0:1779690407.694156:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 435 00000100:00100000:1.0:1779690407.694561:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+35:101689:x1866137503605504:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690407.694582:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.694602:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedaa9 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694664:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694688:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694698:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694714:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694721:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694727:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694977:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e502 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.694987:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695010:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690407.695046:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7a:0x0]: returning size 512 00000004:00200000:1.0:1779690407.695050:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690407.695073:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695084:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695101:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695108:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695113:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.695117:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695132:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695143:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690407.695146:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.695150:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.695156:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e4f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696075:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696085:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696091:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696097:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.696101:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696107:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696118:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48b670e4 (ffff9e2f903c9200) 00010000:00010000:1.0:1779690407.696131:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.696135:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696140:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e4fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696191:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaa9 expref: 37 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696205:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9000/0xb4bb873a1913e502 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaa9 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.696223:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.696225:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690407.696228:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9000, rc 0) 00000100:00100000:1.0:1779690407.696307:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+36:101689:x1866137503605504:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2142us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.696315:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 435 00000100:00100000:3.0:1779690407.704437:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.705405:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605632 00000100:00100000:1.0:1779690407.705415:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605632 00000100:00100000:1.0:1779690407.705519:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 436 00000100:00100000:1.0:1779690407.705530:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+36:101689:x1866137503605632:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690407.705550:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.705570:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e509 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedab0 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705629:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705643:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705653:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705667:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705692:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705717:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705795:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705801:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705834:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705841:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.705845:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705852:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705863:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.705866:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.705870:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705876:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e510 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705889:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705896:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705908:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705914:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.705917:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705922:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705930:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f903c9200) 00010000:00010000:1.0:1779690407.705933:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.705935:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705941:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e517 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705975:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e509 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab0 expref: 37 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.705986:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.705988:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.705992:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e509 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab0 expref: 37 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.706001:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690407.706134:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+36:101689:x1866137503605632:12345-192.168.203.5@tcp:101:bash.0 Request processed in 605us (1705us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690407.706152:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 436 00000100:00100000:3.0:1779690407.715057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690407.716768:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605760 00000100:00100000:2.0:1779690407.716779:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605760 00000100:00100000:2.0:1779690407.716888:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 437 00000100:00100000:2.0:1779690407.716900:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:101690:x1866137503605760:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690407.716921:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690407.716941:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedab7 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717015:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717028:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717049:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690407.717110:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690407.717114:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 101 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690407.717140:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717163:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717199:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 36 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.717206:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:2.0:1779690407.717209:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690407.717214:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fe00, rc 0) 00000100:00100000:2.0:1779690407.717279:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101690:x1866137503605760:12345-192.168.203.5@tcp:101:rm.0 Request processed in 382us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690407.717286:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 437 00000100:00100000:0.0:1779690407.722057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.722136:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503605888 00000100:00100000:1.0:1779690407.722146:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503605888 00000100:00100000:1.0:1779690407.722556:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 438 00000100:00100000:1.0:1779690407.722568:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101690:x1866137503605888:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690407.722588:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.722607:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e52c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedabe expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722666:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722693:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722703:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722718:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722725:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.722732:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.723989:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e541 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724021:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724103:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690407.724142:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7a:0x0]: returning size 512 00000004:00200000:1.0:1779690407.724147:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690407.724229:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724242:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724249:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724255:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724312:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.724316:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724323:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724334:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690407.724337:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.724342:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724357:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724371:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724377:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724383:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724387:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.724390:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724396:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724404:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48b670e4 (ffff9e2f903c9200) 00010000:00010000:1.0:1779690407.724406:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.724409:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724414:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e53a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48b670e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724449:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e52c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedabe expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724476:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8600/0xb4bb873a1913e541 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedabe expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.724484:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.724486:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690407.724489:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8600, rc 0) 00000100:00100000:1.0:1779690407.724558:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:101690:x1866137503605888:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1992us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.724567:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 438 00000100:00100000:3.0:1779690407.727726:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.728974:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606016 00000100:00100000:1.0:1779690407.728984:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606016 00000100:00100000:1.0:1779690407.729042:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 439 00000100:00100000:1.0:1779690407.729054:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:101690:x1866137503606016:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690407.729072:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.729090:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e548 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedac5 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729150:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729163:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729174:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729189:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729209:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729216:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729274:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729282:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729288:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729294:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.729298:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729305:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729316:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.729319:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.729323:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729329:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e54f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729343:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729355:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729360:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729366:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.729368:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729374:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729381:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f903c9f00) 00010000:00010000:1.0:1779690407.729384:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.729387:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729393:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e556 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729427:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e548 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedac5 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729436:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.729438:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.729441:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e548 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedac5 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.729463:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690407.729523:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:101690:x1866137503606016:12345-192.168.203.5@tcp:101:rm.0 Request processed in 472us (1802us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690407.729530:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 439 00000100:00100000:2.0:1779690407.732783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690407.732858:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606144 00000100:00100000:3.0:1779690407.732867:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606144 00000100:00100000:3.0:1779690407.732920:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 440 00000100:00100000:3.0:1779690407.732930:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:101690:x1866137503606144:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690407.732947:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690407.732978:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e55d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedacc expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733035:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733062:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733074:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733090:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733097:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733103:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733173:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733181:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733187:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733192:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690407.733196:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733203:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733214:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:3.0:1779690407.733223:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690407.733228:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733234:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e564 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733248:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733253:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733258:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733264:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690407.733267:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733274:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733281:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690407.733284:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690407.733286:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733290:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e56b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733321:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e55d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedacc expref: 38 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733337:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:3.0:1779690407.733339:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690407.733342:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e55d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedacc expref: 38 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.733352:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:3.0:1779690407.733411:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:101690:x1866137503606144:12345-192.168.203.5@tcp:101:rm.0 Request processed in 482us (636us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690407.733418:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 440 00000100:00100000:0.0:1779690407.748415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690407.748513:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606272 00000100:00100000:2.0:1779690407.748523:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606272 00000100:00100000:2.0:1779690407.748585:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 441 00000100:00100000:2.0:1779690407.748595:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:101691:x1866137503606272:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690407.748615:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690407.748636:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e572 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedad3 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748707:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748722:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748733:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748764:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748772:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.748789:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749045:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749053:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749060:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749066:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690407.749070:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749077:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749089:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:2.0:1779690407.749092:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690407.749097:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749103:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e579 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749174:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749181:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749187:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749193:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690407.749195:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749202:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749210:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f826ec800) 00010000:00010000:2.0:1779690407.749213:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690407.749216:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749221:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e580 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749254:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e572 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedad3 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749265:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:2.0:1779690407.749267:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690407.749277:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e572 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedad3 expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690407.749288:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690407.749453:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:101691:x1866137503606272:12345-192.168.203.5@tcp:101:cp.0 Request processed in 858us (1045us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690407.749461:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 441 00000100:00100000:0.0:1779690407.756195:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.756257:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606400 00000100:00100000:1.0:1779690407.756265:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606400 00000100:00100000:1.0:1779690407.756311:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 442 00000100:00100000:1.0:1779690407.756318:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:101691:x1866137503606400:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690407.756334:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.756350:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e587 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedada expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756401:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756412:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756421:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756430:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756434:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756438:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756498:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756503:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756507:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756511:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.756514:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756518:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756527:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.756529:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.756532:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756535:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e58e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756545:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756548:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756552:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756560:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.756562:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756565:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756569:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f903c9f00) 00010000:00010000:1.0:1779690407.756571:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.756572:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756575:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e595 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756599:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e587 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedada expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756608:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.756610:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.756613:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e587 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedada expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.756622:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690407.756766:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:101691:x1866137503606400:12345-192.168.203.5@tcp:101:cp.0 Request processed in 447us (576us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690407.756774:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 442 00000100:00100000:3.0:1779690407.760019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.760179:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606656 00000100:00100000:1.0:1779690407.760197:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606656 00000100:00100000:1.0:1779690407.760252:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 443 00000100:00100000:1.0:1779690407.760262:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:101691:x1866137503606656:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690407.760281:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.760300:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e59c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedae1 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760417:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760433:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760443:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760456:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760463:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.760469:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690407.765759:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e9:0x0], index 1: 0 00010000:00010000:1.0:1779690407.766100:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766117:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766253:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766291:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766298:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766305:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766311:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690407.766315:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766322:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766334:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:1.0:1779690407.766338:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690407.766342:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766348:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e5a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690407.766362:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f3dfa5c9 reply state 00000000776f54d1 transno 12884902099 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690407.766371:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1779690407.766416:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e59c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 40 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766432:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.766439:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690407.766442:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690407.766444:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690407.766507:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:101691:x1866137503606656:12345-192.168.203.5@tcp:101:cp.0 Request processed in 6246us (6496us total) trans 12884902099 rc 0/0 00000100:00100000:1.0:1779690407.766515:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 443 00000100:00100000:0.0:1779690407.770550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.770624:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606784 00000100:00100000:1.0:1779690407.770635:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606784 00000100:00100000:1.0:1779690407.770712:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6390 00000100:00080000:2.0:1779690407.770716:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690407.770723:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503606784:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690407.770739:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.770760:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedae8 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690407.770862:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690407.770881:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690407.770883:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690407.770892:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 11 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.770909:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 11 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.770941:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690407.771004:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503606784:12345-192.168.203.5@tcp:101:cp.0 Request processed in 283us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.771011:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6390 00010000:00010000:3.0:1779690407.771334:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771344:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771351:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771358:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690407.771362:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771369:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771382:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e2f903c9200) 00010000:00010000:3.0:1779690407.771385:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690407.771397:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.771403:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e5aa lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690407.776495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.776564:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503606912 00000100:00100000:1.0:1779690407.776573:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503606912 00000100:00100000:1.0:1779690407.776640:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6391 00000100:00100000:1.0:1779690407.776651:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+11:101691:x1866137503606912:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690407.776676:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690407.776695:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedaef expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.776724:0:40949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 12 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.776733:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690407.776735:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690407.776738:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 12 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.776771:0:40949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 12 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.776794:0:40949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 12 pid: 10273 timeout: 3235 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690407.776872:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088327100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492307328:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690407.776968:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690407.779213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690407.779286:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607040 00000100:00100000:3.0:1779690407.779292:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607040 00010000:00010000:3.0:1779690407.779323:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 13 pid: 10273 timeout: 3235 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690407.779363:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3220 00000100:00100000:3.0:1779690407.779373:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503607040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690407.779385:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690407.779408:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 13 pid: 10273 timeout: 3235 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.779420:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 13 pid: 10273 timeout: 3235 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.779442:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690407.779444:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690407.779450:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 13 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.779459:0:17231:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 13 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690407.779506:0:17231:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 13 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690407.779518:0:17231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17231:1866137492307456:192.168.203.5@tcp:105: 00000100:00100000:3.0:1779690407.779588:0:17231:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f83460840 going to sleep for 11 seconds 00010000:00010000:1.0:1779690407.779862:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913e5bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae8 expref: 13 pid: 10273 timeout: 3235 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690407.779879:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088327100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492307328:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690407.779901:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 12 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690407.779912:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690407.779955:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bb060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+12:101691:x1866137503606912:12345-192.168.203.5@tcp:101:cp.0 Request processed in 3306us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690407.779963:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6391 00000100:00100000:3.0:1779690407.782223:0:17231:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17231:1866137492307456:192.168.203.5@tcp:105: 00010000:00010000:3.0:1779690407.782246:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690407.782287:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503607040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2916us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690407.782297:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3220 00000100:00100000:0.0:1779690407.785585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690407.785662:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607296 00000100:00100000:1.0:1779690407.785680:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607296 00000100:00100000:1.0:1779690407.785729:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:1.0:1779690407.785739:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+39:101691:x1866137503607296:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:1.0:1779690407.786118:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+40:101691:x1866137503607296:12345-192.168.203.5@tcp:35:cp.0 Request processed in 379us (538us total) trans 12884902100 rc 0/0 00000100:00100000:1.0:1779690407.786132:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:2.0:1779690407.881087:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690407.881109:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492307584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690407.881186:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690407.881346:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492307584 00000100:00100000:0.0:1779690407.881354:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492307584 00000100:00100000:0.0:1779690407.881423:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1779690407.881431:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492307584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690407.881464:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690407.881508:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492307584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.881514:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:2.0:1779690407.881612:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690407.881646:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492307584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690407.882222:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492307840:0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882256:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690407.882278:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1779690407.882284:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492307712:0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882309:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690407.882335:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492308224:0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882355:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690407.882398:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492307712 00000100:00100000:0.0:1779690407.882402:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492307712 00000100:00100000:0.0:1779690407.882430:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1779690407.882448:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492307712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882484:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492307712:12345-0@lo:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.882491:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1779690407.882525:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492307712:0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882547:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492307840 00000100:00100000:0.0:1779690407.882550:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492307840 00000100:00100000:0.0:1779690407.882577:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492308224 00000100:00100000:0.0:1779690407.882580:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492308224 00000100:00100000:0.0:1779690407.882598:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1779690407.882604:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492307840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882637:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492307840:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.882643:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1779690407.882655:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1779690407.882660:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492308224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882699:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492308224:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690407.882715:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1779690407.882741:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492308224:0@lo:400:kworker.0 00000100:00100000:0.0:1779690407.882751:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492307840:0@lo:400:kworker.0 00000100:00080000:2.0:1779690407.882953:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690407.882973:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492307968:0@lo:400:kworker.0 00000100:00100000:2.0:1779690407.883000:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690407.883020:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690407.883026:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492308096:0@lo:400:kworker.0 00000100:00100000:2.0:1779690407.883048:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690407.883074:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492308096 00000100:00100000:2.0:1779690407.883077:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492308096 00000100:00100000:2.0:1779690407.883112:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:2.0:1779690407.883133:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492308096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690407.883167:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492308096:12345-0@lo:400:kworker.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690407.883173:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:2.0:1779690407.883199:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690407.883216:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492308096:0@lo:400:kworker.0 00000100:00100000:2.0:1779690407.883236:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492307968 00000100:00100000:2.0:1779690407.883239:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492307968 00000100:00080000:2.0:1779690407.883253:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690407.883275:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1779690407.883281:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492307968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690407.883318:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492307968:12345-0@lo:400:kworker.0 Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690407.883325:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1779690407.883346:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492307968:0@lo:400:kworker.0 00000040:00080000:1.0:1779690407.883641:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690407.883647:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690407.884320:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:1.0:1779690407.884338:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690407.884888:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690407.884901:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492308352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690407.884942:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690407.885188:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492308352 00000100:00100000:2.0:1779690407.885194:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492308352 00000100:00100000:2.0:1779690407.885230:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1779690407.885236:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492308352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690407.885262:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690407.885307:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492308352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690407.885314:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1779690407.885549:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492308352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1779690408.393540:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690409.147357:0:64228:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690409.147367:0:64228:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690409.148006:0:64228:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690409.148015:0:64228:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690409.421023:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1779690409.835163:0:64276:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc400e87c0 00000004:00000080:2.0:1779690409.835176:0:64276:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e30b43f0000 uarg=0000000000000000 00000004:00000080:2.0:1779690409.835213:0:64276:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e30b43f0000 00000040:00080000:2.0:1779690409.835541:0:64276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].2, 80 off8352 00000004:00000080:2.0:1779690409.835559:0:64276:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl2', mask 0x0 00000004:02000000:2.0:1779690409.835562:0:64276:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000001:00080000:3.0:1779690409.989306:0:63719:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902100 is committed 00000001:00080000:3.0:1779690409.989330:0:63719:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902098 is committed 00000100:00100000:2.0:1779690409.998362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690409.998520:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607424 00000100:00100000:0.0:1779690409.998528:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607424 00000100:00100000:0.0:1779690409.998626:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 444 00000100:00100000:0.0:1779690409.998637:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:101740:x1866137503607424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690409.998678:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690409.998699:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e5cd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedaf6 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.998769:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.998781:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.998793:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690409.998836:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690409.998840:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.998848:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.998855:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999177:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999187:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999193:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690409.999226:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x15:0x0]: returning size 1516 00000004:00200000:0.0:1779690409.999233:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690409.999250:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999259:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999264:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999269:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999273:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999276:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690409.999278:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999283:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999291:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:0.0:1779690409.999292:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690409.999295:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999299:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e5d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999307:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999317:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999320:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999323:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690409.999325:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999328:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999332:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e308bf54d00) 00010000:00010000:0.0:1779690409.999333:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690409.999335:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999338:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5db lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999359:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e5cd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaf6 expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999367:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaf6 expref: 36 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690409.999372:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690409.999374:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690409.999379:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:0.0:1779690410.000020:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+36:101740:x1866137503607424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1383us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690410.000026:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 444 00000100:00100000:2.0:1779690410.002619:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690410.002717:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607552 00000100:00100000:0.0:1779690410.002726:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607552 00000100:00100000:0.0:1779690410.002916:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6392 00000100:00100000:0.0:1779690410.002926:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503607552:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690410.002954:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690410.002970:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060adb618/0xb4bb873a1913e5e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedafd expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690410.003025:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492308480:192.168.203.5@tcp:106: 00000100:00080000:2.0:1779690410.003063:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690410.003118:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953da9c0 going to sleep for 11 seconds 00002000:00010000:0.0:1779690410.004498:0:22279:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1779690410.004503:0:22279:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb mtime: 0 -> 1779690407 00002000:00010000:0.0:1779690410.004506:0:22279:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb atime: 0 -> 1779690407 00002000:00010000:0.0:1779690410.004518:0:22279:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb ctime: 0 -> 1779690407 00000100:00100000:0.0:1779690410.004543:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492308480:192.168.203.5@tcp:106: 00010000:00010000:0.0:1779690410.004571:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060adb618/0xb4bb873a1913e5e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedafd expref: 16 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.004592:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060adb618/0xb4bb873a1913e5e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedafd expref: 16 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.004613:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690410.004680:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503607552:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1756us (2068us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690410.004688:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6392 00000100:00100000:2.0:1779690410.009019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690410.009236:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607680 00000100:00100000:0.0:1779690410.009245:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607680 00000100:00100000:0.0:1779690410.009405:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 445 00000100:00100000:0.0:1779690410.009428:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+36:101740:x1866137503607680:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690410.009446:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690410.009464:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e5f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb04 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009527:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009541:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009551:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690410.009779:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7a:0x0]: returning size 7680 00000004:00200000:0.0:1779690410.009783:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690410.009898:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009925:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e5f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb04 expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009941:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb04 expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690410.009962:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:0.0:1779690410.009964:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690410.009968:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c800, rc 0) 00000100:00100000:0.0:1779690410.010026:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+37:101740:x1866137503607680:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 611us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690410.010033:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 445 00000100:00100000:2.0:1779690410.013932:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690410.013995:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503607808 00000100:00100000:3.0:1779690410.014005:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503607808 00000100:00100000:3.0:1779690410.014050:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6393 00000100:00100000:3.0:1779690410.014060:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503607808:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690410.014089:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690410.014163:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e7e0544/0xb4bb873a1913e5fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb0b expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690410.014227:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492308608:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690410.014382:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90821480 going to sleep for 11 seconds 00000100:00100000:1.0:1779690410.018307:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492308608:192.168.203.5@tcp:106: 00010000:00010000:1.0:1779690410.018344:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e7e0544/0xb4bb873a1913e5fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb0b expref: 16 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690410.018363:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e7e0544/0xb4bb873a1913e5fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb0b expref: 16 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690410.018371:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:1.0:1779690410.018425:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503607808:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 4361us (4496us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690410.018431:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6393 00000100:00100000:2.0:1779690410.023594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690410.023845:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608064 00000100:00100000:1.0:1779690410.023854:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608064 00000100:00100000:1.0:1779690410.023913:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 446 00000100:00100000:1.0:1779690410.023923:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+37:101740:x1866137503608064:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:1.0:1779690410.024414:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].21, 136 off11048 00000100:00100000:1.0:1779690410.024542:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+37:101740:x1866137503608064:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 620us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690410.024550:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 446 00000100:00100000:2.0:1779690410.433005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690410.433052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690410.433079:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608192 00000100:00100000:0.0:1779690410.433090:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608192 00000100:00100000:3.0:1779690410.433125:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608320 00000100:00100000:3.0:1779690410.433130:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608320 00000100:00100000:3.0:1779690410.433204:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:3.0:1779690410.433218:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:2389:x1866137503608320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690410.433234:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:0.0:1779690410.433244:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503608192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1779690410.433306:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690410.433393:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:2389:x1866137503608320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 178us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690410.433400:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:0.0:1779690410.436009:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503608192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2756us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690410.436022:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:0.0:1779690410.439196:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690410.439265:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608448 00000100:00100000:1.0:1779690410.439272:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608448 00000100:00100000:1.0:1779690410.439340:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2816 00000100:00100000:1.0:1779690410.439351:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503608448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1779690410.439411:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690410.439551:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503608448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 201us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690410.439573:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2816 00010000:00010000:1.0:1779690410.440998:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690410.441235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690410.441731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690410.441761:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608576 00000100:00100000:0.0:1779690410.441768:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608576 00000100:00100000:0.0:1779690410.441890:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608704 00000100:00100000:0.0:1779690410.441894:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608704 00000100:00100000:0.0:1779690410.441920:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2817 00000100:00100000:0.0:1779690410.441929:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503608576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690410.441983:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503608576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 55us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690410.441990:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2817 00000100:00100000:0.0:1779690410.442018:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2818 00000100:00100000:0.0:1779690410.442023:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503608704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690410.442062:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503608704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690410.442067:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2818 00000100:00080000:0.0:1779690410.442085:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690410.442089:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1779690410.567327:0:64327:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690410.567335:0:64327:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690410.567417:0:64327:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 22 count 14 00000040:00080000:2.0:1779690410.567423:0:64327:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690410.953215:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690410.953224:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690410.953265:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 22 count 14 00000040:00080000:3.0:1779690410.953272:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690410.953837:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492308736:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690410.954178:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90821480 going to sleep for 11 seconds 00000100:00100000:3.0:1779690410.961076:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492308736:192.168.203.5@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1779690411.465940:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690412.163086:0:64379:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690412.163092:0:64379:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690412.163139:0:64379:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 22 count 14 00000040:00080000:1.0:1779690412.163143:0:64379:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690412.219022:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.220112:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503608832 00000100:00100000:0.0:1779690412.220122:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503608832 00000100:00100000:0.0:1779690412.220214:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6394 00000100:00100000:0.0:1779690412.220225:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503608832:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690412.220242:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690412.220258:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c7fd1a/0xb4bb873a1913e605 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb12 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690412.220314:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492308864:192.168.203.5@tcp:106: 00000100:00080000:2.0:1779690412.220343:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690412.220415:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953da000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690412.222355:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492308864:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690412.222400:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057c7fd1a/0xb4bb873a1913e605 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb12 expref: 16 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.222438:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c7fd1a/0xb4bb873a1913e605 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb12 expref: 16 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.222471:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483de00, rc 0) 00000100:00100000:3.0:1779690412.222522:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2390:x1866137503608832:12345-192.168.203.5@tcp:101:rm.0 Request processed in 2298us (3507us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690412.222530:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6394 00000100:00100000:2.0:1779690412.228480:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.231191:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609088 00000100:00100000:0.0:1779690412.231204:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609088 00000100:00080000:2.0:1779690412.231343:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690412.231462:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 447 00000100:00100000:0.0:1779690412.231473:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+37:101758:x1866137503609088:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:0.0:1779690412.231533:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1779690412.231560:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e5e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaf6 expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231599:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690412.231615:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e5f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb04 expref: 36 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231634:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:0.0:1779690412.231638:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690412.231662:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231675:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231686:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231719:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231727:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.231733:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.232184:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.232196:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 35 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.232218:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.232252:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 35 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690412.232266:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 35 pid: 57561 timeout: 3239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690412.232282:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492308992:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690412.232367:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690412.242745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690412.242824:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492308992:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690412.242852:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690412.243094:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609216 00000100:00100000:1.0:1779690412.243101:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609216 00010000:00010000:1.0:1779690412.243155:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 36 pid: 57561 timeout: 3239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690412.243188:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3221 00000100:00100000:1.0:1779690412.243196:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503609216:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690412.243209:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690412.243214:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 36 pid: 57561 timeout: 3239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.243227:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 36 pid: 57561 timeout: 3239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.243247:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e5b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedae1 expref: 36 pid: 57561 timeout: 3239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690412.243248:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690412.243264:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690412.243269:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.243290:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.243298:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.243322:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690412.243341:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.243350:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690412.243374:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+35:2392:x1866137503609216:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 178us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690412.243389:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3221 00000040:00080000:2.0:1779690412.244474:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].5, 64 off8536 00000004:00080000:2.0:1779690412.244484:0:57560:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3139818678100ns, next at 3140818675796ns, rc = 0 00010000:00010000:2.0:1779690412.244587:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244601:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244617:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244638:0:57560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244644:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244650:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244673:0:57560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690412.244694:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244700:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244706:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244712:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690412.244716:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244723:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244733:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690412.244735:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1779690412.244746:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244752:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e61a lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244770:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244776:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244782:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244787:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690412.244789:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244795:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244828:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0x0 (ffff9e2f903c9800) 00010000:00010000:3.0:1779690412.244830:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690412.244831:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690412.244837:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.244839:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690412.244850:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e60c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.244853:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690412.244859:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690412.244865:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009f4a4185 reply state 00000000b0c1eb13 transno 12884902101 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.244867:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.244888:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690412.244894:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690412.244898:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690412.244902:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690412.244919:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e621 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.244935:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690412.244937:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690412.244939:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690412.244973:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+37:101758:x1866137503609088:12345-192.168.203.5@tcp:36:rm.0 Request processed in 13501us (16502us total) trans 12884902101 rc 0/0 00000100:00100000:2.0:1779690412.244980:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 447 00010000:00010000:3.0:1779690412.249665:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249683:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249690:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249696:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690412.249700:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249707:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249722:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7a:0x0].0xe2288a63 (ffff9e308bf54d00) 00010000:00010000:3.0:1779690412.249725:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690412.249730:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690412.249736:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e613 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7a:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690412.307948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690412.308295:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609344 00000100:00100000:1.0:1779690412.308306:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609344 00000100:00100000:1.0:1779690412.308370:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 448 00000100:00100000:1.0:1779690412.308380:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101765:x1866137503609344:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690412.308410:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x15:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1779690412.308482:0:57585:0:(mdt_handler.c:8003:mdt_fid2path()) nonlocal object [0x200000bd3:0x15:0x0]: rc = -2 00000100:00100000:1.0:1779690412.308540:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101765:x1866137503609344:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 161us (600us total) trans 0 rc -2/-2 00000100:00100000:1.0:1779690412.308548:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 448 00000100:00100000:2.0:1779690412.317784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690412.318277:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609600 00000100:00100000:1.0:1779690412.318286:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609600 00000100:00100000:1.0:1779690412.318341:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 449 00000100:00100000:1.0:1779690412.318350:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:101765:x1866137503609600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690412.318368:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690412.318433:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e628 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb19 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.318583:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e628 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb19 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.318597:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690412.318600:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690412.318605:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913e628 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb19 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.318618:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690412.318692:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:101765:x1866137503609600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 342us (915us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690412.318700:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 449 00000100:00100000:1.0:1779690412.324750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690412.324782:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609856 00000100:00100000:1.0:1779690412.324792:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609856 00000100:00100000:1.0:1779690412.324855:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 450 00000100:00100000:1.0:1779690412.324865:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+35:101765:x1866137503609856:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690412.324999:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325015:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325026:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325036:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325051:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325057:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325063:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690412.325066:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325073:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325084:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x15:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:1.0:1779690412.325087:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690412.325091:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690412.325097:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e62f lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690412.325512:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101765:x1866137503609856:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 648us (769us total) trans 12884902102 rc 0/0 00000100:00100000:1.0:1779690412.325520:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 450 00000040:00080000:1.0:1779690412.325622:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690412.325639:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690412.325905:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 22 count 12 00000040:00080000:1.0:1779690412.325912:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690412.489964:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690412.877902:0:64431:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690412.877911:0:64431:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690412.877994:0:64431:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 22 count 12 00000040:00080000:2.0:1779690412.878000:0:64431:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690412.922001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690412.922077:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503609984 00000100:00100000:2.0:1779690412.922085:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503609984 00000100:00100000:2.0:1779690412.922145:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 451 00000100:00100000:2.0:1779690412.922156:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503609984:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690412.922316:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503609984:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 162us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690412.922323:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 451 00000100:00100000:2.0:1779690412.924488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.924551:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610112 00000100:00100000:0.0:1779690412.924557:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610112 00000100:00100000:0.0:1779690412.924602:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 452 00000100:00100000:0.0:1779690412.924612:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610112:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690412.924829:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690412.924880:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610112:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 269us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690412.924887:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 452 00000100:00100000:1.0:1779690412.930674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.930844:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610240 00000100:00100000:0.0:1779690412.930854:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610240 00000100:00100000:0.0:1779690412.930907:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 453 00000100:00100000:0.0:1779690412.930918:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610240:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690412.931059:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690412.931152:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610240:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 235us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690412.931160:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 453 00000100:00100000:0.0:1779690412.933386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690412.933457:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610368 00000100:00100000:2.0:1779690412.933464:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610368 00000100:00100000:2.0:1779690412.933516:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 454 00000100:00100000:2.0:1779690412.933527:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610368:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690412.933662:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690412.933740:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610368:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 215us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690412.933758:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 454 00000100:00100000:2.0:1779690412.935782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.935902:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610496 00000100:00100000:0.0:1779690412.935908:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610496 00000100:00100000:0.0:1779690412.935952:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 455 00000100:00100000:0.0:1779690412.935960:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610496:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690412.936047:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610496:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690412.936054:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 455 00000100:00100000:0.0:1779690412.940588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690412.940680:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610624 00000100:00100000:1.0:1779690412.940689:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610624 00000100:00100000:1.0:1779690412.940785:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 456 00000100:00100000:1.0:1779690412.940797:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610624:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690412.941000:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610624:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 205us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690412.941009:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 456 00000100:00100000:3.0:1779690412.945382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.945471:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610752 00000100:00100000:0.0:1779690412.945483:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610752 00000100:00100000:0.0:1779690412.945547:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 457 00000100:00100000:0.0:1779690412.945557:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690412.945732:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690412.945741:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 457 00000100:00100000:3.0:1779690412.952892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690412.952957:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503610880 00000100:00100000:0.0:1779690412.952968:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503610880 00000100:00100000:0.0:1779690412.953030:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 458 00000100:00100000:0.0:1779690412.953041:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690412.953203:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101780:x1866137503610880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 164us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690412.953211:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 458 00000100:00100000:2.0:1779690413.001064:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492309120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690413.001133:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690413.001192:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492309248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690413.001205:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309120 00000100:00100000:0.0:1779690413.001215:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309120 00000100:00100000:3.0:1779690413.001261:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1779690413.001283:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690413.001300:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309248 00000100:00100000:0.0:1779690413.001304:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309248 00000100:00100000:0.0:1779690413.001351:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1779690413.001366:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492309120:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1779690413.001368:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690413.001387:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1779690413.001403:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492309248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690413.001408:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690413.001422:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492309760:0@lo:400:kworker.0 00002000:00000024:1.0:1779690413.001432:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690413.001436:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492309376:0@lo:400:kworker.0 00000100:00100000:2.0:1779690413.001459:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690413.001475:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492309120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690413.001484:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1779690413.001511:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690413.001522:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492309248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690413.001526:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492309504:0@lo:400:kworker.0 00000100:00100000:1.0:1779690413.001534:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1779690413.001538:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492309248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690413.001566:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1779690413.001566:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690413.001578:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492309632:0@lo:400:kworker.0 00000100:00100000:2.0:1779690413.001611:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690413.001611:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309760 00000100:00100000:1.0:1779690413.001628:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309760 00000100:00100000:2.0:1779690413.001672:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309504 00000100:00100000:3.0:1779690413.001677:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309376 00000100:00100000:2.0:1779690413.001677:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309504 00000100:00100000:1.0:1779690413.001686:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309632 00000100:00100000:3.0:1779690413.001688:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309376 00000100:00100000:1.0:1779690413.001693:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309632 00000100:00100000:2.0:1779690413.001726:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1779690413.001735:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1779690413.001737:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492309760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690413.001748:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492309504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690413.001777:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1779690413.001778:0:57559:0:(service.c:3465:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1779690413.001788:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492309760:12345-0@lo:400:kworker.0 Request processed in 54us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690413.001791:0:57559:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1779690413.001797:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492309376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690413.001828:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1779690413.001849:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1779690413.001858:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690413.001914:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492309632:12345-0@lo:400:kworker.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690413.001921:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1779690413.001944:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690413.001950:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492309376:12345-0@lo:400:kworker.0 Request processed in 159us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690413.001950:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492309504:12345-0@lo:400:kworker.0 Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690413.001980:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1779690413.001982:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1779690413.001991:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492309632:0@lo:400:kworker.0 00000100:00100000:0.0:1779690413.001997:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492309376:0@lo:400:kworker.0 00000100:00100000:2.0:1779690413.002005:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492309760:0@lo:400:kworker.0 00000100:00100000:1.0:1779690413.002033:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492309504:0@lo:400:kworker.0 00000100:00100000:3.0:1779690413.002272:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492309120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1779690413.515676:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690414.537111:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690415.095870:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902102 is committed 00000001:00080000:3.0:1779690415.095895:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902101 is committed 00000004:00080000:3.0:1779690415.095900:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1779690415.096116:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492309888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1779690415.096191:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690415.096462:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492309888 00000100:00100000:3.0:1779690415.096470:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492309888 00000100:00100000:3.0:1779690415.096606:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6395 00000100:00100000:3.0:1779690415.096616:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492309888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1779690415.096642:0:15940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:489 count 1 00010000:00010000:3.0:1779690415.096666:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.096686:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 10 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.096774:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690415.096776:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690415.096780:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.096831:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 10 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.096845:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 10 pid: 40949 timeout: 3242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690415.096857:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492310016:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690415.096930:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138f00 going to sleep for 11 seconds 00000100:00080000:2.0:1779690415.100627:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690415.101972:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492310016:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690415.102004:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690415.104925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.104980:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611008 00000100:00100000:3.0:1779690415.104991:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611008 00010000:00010000:3.0:1779690415.105047:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 11 pid: 40949 timeout: 3242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690415.105079:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3222 00000100:00100000:3.0:1779690415.105088:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503611008:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690415.105100:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690415.105105:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 11 pid: 40949 timeout: 3242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105118:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 11 pid: 40949 timeout: 3242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105150:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002062469d/0xb4bb873a1913e5c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaef expref: 11 pid: 40949 timeout: 3242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105164:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690415.105166:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690415.105171:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105180:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105207:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690415.105251:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503611008:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.105258:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3222 00010000:00010000:3.0:1779690415.105285:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105295:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105305:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105313:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690415.105336:0:15940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1779690415.105635:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690415.105847:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1779690415.105854:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690415.105862:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690415.105866:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690415.105874:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690415.105893:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690415.105901:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13ebc56/0xb4bb873a1913e636 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690415.105919:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690415.105921:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690415.105923:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690415.106198:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492309888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9582us (10005us total) trans 4294968403 rc 0/0 00000100:00100000:3.0:1779690415.106207:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6395 00000004:00080000:0.0:1779690415.106369:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e30888f8000/2, rc 0, transno 4294968403 00000100:00100000:0.0:1779690415.106377:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492309888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1779690415.556962:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690415.558315:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611136 00000100:00100000:1.0:1779690415.558326:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611136 00000100:00100000:1.0:1779690415.558455:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:1.0:1779690415.558465:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503611136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690415.558556:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503611136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 93us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690415.558563:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:3.0:1779690415.560953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.561187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.561264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.561291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.561315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690415.561347:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611392 00000100:00100000:3.0:1779690415.561354:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611392 00000100:00100000:3.0:1779690415.561401:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611648 00000100:00100000:3.0:1779690415.561404:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611648 00000100:00100000:3.0:1779690415.561578:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611776 00000100:00100000:3.0:1779690415.561581:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611776 00000100:00100000:3.0:1779690415.561625:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2819 00000100:00100000:3.0:1779690415.561635:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503611392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690415.561697:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503611392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 63us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.561704:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2819 00000100:00100000:3.0:1779690415.561723:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2820 00000100:00100000:3.0:1779690415.561729:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503611648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690415.561755:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503611648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.561775:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2820 00000100:00100000:3.0:1779690415.561789:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2821 00000100:00100000:3.0:1779690415.561795:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503611776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690415.561842:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503611776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.561904:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2821 00000100:00100000:3.0:1779690415.561926:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611264 00000100:00100000:3.0:1779690415.561930:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611264 00000100:00100000:3.0:1779690415.561955:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611520 00000100:00100000:3.0:1779690415.561958:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611520 00000100:00100000:3.0:1779690415.561977:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:3.0:1779690415.561984:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:2392:x1866137503611264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690415.562012:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+35:2392:x1866137503611264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.562019:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:3.0:1779690415.562030:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:3.0:1779690415.562036:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:2392:x1866137503611520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690415.562135:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:2392:x1866137503611520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690415.562142:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00080000:3.0:1779690415.562166:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690415.562171:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690415.562173:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690415.562607:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690416.588164:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690417.208504:0:64628:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690417.208510:0:64628:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690417.208550:0:64628:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 3 count 2 00000040:00080000:1.0:1779690417.208556:0:64628:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690417.255649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690417.256555:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503611904 00000100:00100000:3.0:1779690417.256565:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503611904 00000100:00100000:3.0:1779690417.257124:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 459 00000100:00100000:3.0:1779690417.257135:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+35:102223:x1866137503611904:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:3.0:1779690417.257176:0:64445:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b39923e8 uarg=0000000000000000 00000004:00000080:3.0:1779690417.257211:0:64445:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b39923e8 00000004:00000080:3.0:1779690417.257217:0:64445:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1779690417.257297:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690417.257302:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1779690417.257334:0:64445:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 6 00000040:00080000:3.0:1779690417.257495:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 3 count 2 00000040:00080000:3.0:1779690417.257501:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690417.257506:0:64445:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1779690417.257539:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690417.257542:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000100:00080000:0.0:1779690417.258007:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1779690417.258515:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 6 count 1 00000040:00080000:3.0:1779690417.258523:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1779690417.259046:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+35:102223:x1866137503611904:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1909us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690417.259057:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 459 00010000:00010000:3.0:1779690417.609784:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1779690417.937290:0:64676:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffd14dc9060 00000004:00000080:3.0:1779690417.937306:0:64676:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e2f88e3d800 uarg=0000000000000000 00000004:00000080:3.0:1779690417.937343:0:64676:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e2f88e3d800 00000004:00000080:3.0:1779690417.937350:0:64676:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1779690417.937445:0:64676:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690417.937449:0:64676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1779690417.937477:0:64676:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 6 00000040:00080000:3.0:1779690417.937545:0:64676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 3 count 2 00000040:00080000:3.0:1779690417.937740:0:64676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690417.937774:0:64676:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1779690417.938089:0:64676:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690417.938092:0:64676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1779690417.938671:0:64676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:3.0:1779690417.938678:0:64676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1779690417.938704:0:64676:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=2 00000040:00080000:3.0:1779690417.938748:0:64676:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690417.938750:0:64676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690417.939047:0:64676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 2 count 1 00000040:00080000:3.0:1779690417.939052:0:64676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690417.939069:0:64676:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1779690417.939071:0:64676:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1779690417.941492:0:64676:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl2 record=18446744073709551615 00000040:00080000:2.0:1779690417.941693:0:64676:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690417.941698:0:64676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690417.942874:0:64676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690417.942885:0:64676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1779690417.942995:0:64676:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690417.942998:0:64676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690417.944611:0:64676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690417.944624:0:64676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690418.121983:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690418.122005:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492310144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690418.122066:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690418.122123:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310144 00000100:00100000:0.0:1779690418.122130:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310144 00000100:00100000:0.0:1779690418.122225:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1779690418.122232:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492310144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690418.122263:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690418.122301:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492310144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690418.122307:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00080000:0.0:1779690418.122325:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690418.122355:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492310144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690418.122557:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492310400:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.122599:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690418.122617:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1779690418.122622:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492310272:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.122645:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690418.122666:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492310784:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.122686:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690418.122786:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310400 00000100:00100000:3.0:1779690418.122791:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310400 00000100:00100000:3.0:1779690418.122839:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310784 00000100:00100000:3.0:1779690418.122842:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310784 00000100:00100000:3.0:1779690418.122860:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1779690418.122866:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492310400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1779690418.123794:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690418.123831:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492310528:0@lo:400:kworker.0 00000100:00100000:0.0:1779690418.123863:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690418.123884:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690418.123890:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492310656:0@lo:400:kworker.0 00000100:00100000:0.0:1779690418.123912:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690418.123936:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310528 00000100:00100000:0.0:1779690418.123940:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310528 00000100:00100000:0.0:1779690418.123974:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1779690418.123981:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492310784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690418.125646:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492310400:12345-0@lo:400:kworker.0 Request processed in 2775us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690418.125656:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1779690418.125685:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1779690418.125694:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492310528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690418.125827:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492310528:12345-0@lo:400:kworker.0 Request processed in 135us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690418.125833:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1779690418.125865:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310272 00000100:00100000:3.0:1779690418.125870:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310272 00000100:00100000:3.0:1779690418.125911:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1779690418.125918:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492310272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690418.125996:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492310784:12345-0@lo:400:kworker.0 Request processed in 2014us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690418.126004:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1779690418.126026:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310656 00000100:00100000:0.0:1779690418.126030:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310656 00000100:00100000:0.0:1779690418.126057:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1779690418.126063:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492310656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690418.126091:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492310656:12345-0@lo:400:kworker.0 Request processed in 28us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690418.126096:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00080000:0.0:1779690418.126112:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690418.126116:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690418.127530:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492310272:12345-0@lo:400:kworker.0 Request processed in 1609us (4880us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690418.127539:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1779690418.127653:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690418.127787:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492310656:0@lo:400:kworker.0 00000100:00100000:3.0:1779690418.127800:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492310528:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.127950:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492310272:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.127964:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492310784:0@lo:400:kworker.0 00000100:00100000:1.0:1779690418.127974:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492310400:0@lo:400:kworker.0 00000100:00100000:2.0:1779690418.131630:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492310912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690418.131694:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690418.131852:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492310912 00000100:00100000:3.0:1779690418.131860:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492310912 00000100:00100000:3.0:1779690418.131904:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1779690418.131913:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492310912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690418.131945:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690418.131991:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492310912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690418.131998:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1779690418.132042:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492310912:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1779690418.628103:0:64724:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690418.628112:0:64724:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690418.628973:0:64724:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690418.628984:0:64724:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690418.633154:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690418.698200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690418.701851:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612032 00000100:00100000:1.0:1779690418.701864:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612032 00000100:00100000:2.0:1779690418.702247:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 460 00000100:00100000:2.0:1779690418.702258:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:101687:x1866137503612032:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1779690418.702364:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:101687:x1866137503612032:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 107us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690418.702380:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 460 00000100:00100000:3.0:1779690418.712139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690418.712272:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612288 00000100:00100000:1.0:1779690418.712281:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612288 00000100:00100000:1.0:1779690418.712348:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:1.0:1779690418.712359:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+35:101687:x1866137503612288:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690418.715262:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+36:101687:x1866137503612288:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 2897us (3122us total) trans 12884902103 rc 0/0 00000100:00100000:1.0:1779690418.715274:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00010000:00010000:3.0:1779690419.657063:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1779690419.897397:0:64773:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 221: Changelog for archive canceled === 02:26:58 (1779690418) 00000100:00100000:0.0:1779690419.939241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690419.939309:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612416 00000100:00100000:3.0:1779690419.939318:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612416 00000100:00100000:3.0:1779690419.939390:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 461 00000100:00100000:3.0:1779690419.939400:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+35:102391:x1866137503612416:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690419.939419:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690419.939471:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e63d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb20 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939535:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939665:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939678:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939707:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939715:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.939722:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940132:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940141:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940148:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940153:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690419.940158:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940175:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940188:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690419.940191:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690419.940196:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940201:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940212:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940218:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940223:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940228:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690419.940231:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940237:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940244:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab856785 (ffff9e2f883cb000) 00010000:00010000:3.0:1779690419.940246:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690419.940249:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940264:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e64b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940296:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e63d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb20 expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940306:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690419.940308:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690419.940312:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e63d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb20 expref: 36 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.940323:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00080000:0.0:1779690419.940463:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690419.940743:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+35:102391:x1866137503612416:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1344us (1510us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690419.940751:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 461 00000100:00100000:0.0:1779690419.947456:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690419.947533:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612672 00000100:00100000:2.0:1779690419.947542:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612672 00000100:00100000:2.0:1779690419.947610:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 462 00000100:00100000:2.0:1779690419.947621:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:102391:x1866137503612672:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:2.0:1779690419.947674:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690419.947701:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e4e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedaa2 expref: 35 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.947719:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:2.0:1779690419.947724:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690419.948016:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.948031:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 35 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.948040:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.948073:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 35 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.948088:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 35 pid: 57560 timeout: 3247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690419.948117:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492311040:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690419.948208:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1779690419.957253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690419.957317:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612800 00000100:00100000:3.0:1779690419.957326:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612800 00010000:00010000:3.0:1779690419.957383:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 36 pid: 57560 timeout: 3247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690419.957419:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3223 00000100:00100000:3.0:1779690419.957429:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503612800:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690419.957444:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690419.957450:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 36 pid: 57560 timeout: 3247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.957478:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 36 pid: 57560 timeout: 3247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.957500:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690419.957505:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.957516:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.957523:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.957544:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690419.957602:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+36:2392:x1866137503612800:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 175us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690419.957610:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3223 00000100:00080000:1.0:1779690419.957670:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690419.957718:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e525 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedab7 expref: 35 pid: 57560 timeout: 3247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690419.957731:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492311040:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690419.957763:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.957771:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.957776:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.957799:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.958213:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.958223:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690419.959673:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7b:0x0]: returning size 512 00010000:00010000:2.0:1779690419.959686:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959695:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959709:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959714:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690419.959718:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959726:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959739:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:2.0:1779690419.959741:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690419.959746:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690419.959752:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e652 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690419.959769:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002f16ada8 reply state 000000001074968e transno 12884902104 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690419.959778:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690419.959882:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+36:102391:x1866137503612672:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 12261us (12432us total) trans 12884902104 rc 0/0 00000100:00100000:2.0:1779690419.959890:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 462 00010000:00010000:3.0:1779690419.968759:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968775:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968783:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968788:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690419.968793:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968906:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968921:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab856785 (ffff9e2f826ec800) 00010000:00010000:3.0:1779690419.968923:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690419.968928:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.968933:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e659 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690419.997289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690419.997364:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503612928 00000100:00100000:3.0:1779690419.997374:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503612928 00000100:00100000:3.0:1779690419.997430:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 463 00000100:00100000:3.0:1779690419.997440:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+35:102400:x1866137503612928:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1779690419.997463:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690419.997484:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb27 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997555:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997569:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997580:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690419.997635:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690419.997647:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 102 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690419.997682:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997706:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb27 expref: 37 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997723:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb27 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690419.997732:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:3.0:1779690419.997735:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690419.997738:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e000, rc 0) 00000100:00100000:3.0:1779690419.997824:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+36:102400:x1866137503612928:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 364us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690419.997832:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 463 00000100:00100000:1.0:1779690420.004068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690420.004107:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.010230:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613056 00000100:00100000:2.0:1779690420.010244:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613056 00000100:00100000:2.0:1779690420.010291:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613312 00000100:00100000:2.0:1779690420.010295:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613312 00000100:00100000:2.0:1779690420.010327:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 464 00000100:00100000:2.0:1779690420.010348:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:2391:x1866137503613056:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:2.0:1779690420.010390:0:64445:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257977344 avail 2255880192 00000100:00100000:2.0:1779690420.010461:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:2391:x1866137503613056:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 117us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.010469:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 464 00000100:00100000:2.0:1779690420.010486:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 465 00000100:00100000:2.0:1779690420.010493:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+36:102400:x1866137503613312:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:2.0:1779690420.010529:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690420.010562:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e667 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb27 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.010578:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:2.0:1779690420.010589:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690420.010701:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+35:102400:x1866137503613312:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 209us (6593us total) trans 0 rc -17/-17 00000100:00100000:2.0:1779690420.010708:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 465 00000100:00100000:1.0:1779690420.023984:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.028169:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613440 00000100:00100000:2.0:1779690420.028183:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613440 00000100:00100000:2.0:1779690420.028249:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 466 00000100:00100000:2.0:1779690420.028260:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+35:102400:x1866137503613440:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690420.028280:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690420.028304:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e66e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb2e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028372:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028398:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028410:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690420.028469:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690420.028473:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 102 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690420.028497:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028521:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e66e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 37 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028537:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 36 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.028559:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690420.028562:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690420.028566:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f800, rc 0) 00000100:00100000:2.0:1779690420.028629:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+36:102400:x1866137503613440:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 371us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.028636:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 466 00000100:00100000:2.0:1779690420.043286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.043325:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613568 00000100:00100000:2.0:1779690420.043334:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613568 00000100:00100000:2.0:1779690420.043388:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 467 00000100:00100000:2.0:1779690420.043399:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+36:102400:x1866137503613568:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690420.043427:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690420.043446:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e67c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb35 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.043512:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.043526:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.043538:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.043566:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045015:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045026:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045137:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045146:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045152:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690420.045198:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7b:0x0]: returning size 512 00000004:00200000:2.0:1779690420.045210:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690420.045244:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045257:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045263:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045270:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045276:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690420.045280:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045287:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045299:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690420.045303:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.045308:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045315:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045327:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045333:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045349:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045355:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690420.045358:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045364:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045372:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab856785 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690420.045374:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.045377:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045383:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e68a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045425:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb35 expref: 38 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045441:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb35 expref: 37 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.045448:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690420.045451:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690420.045454:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690420.045526:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:102400:x1866137503613568:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 2129us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.045545:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 467 00000100:00100000:1.0:1779690420.063283:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.063379:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613696 00000100:00100000:2.0:1779690420.063389:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613696 00000100:00100000:2.0:1779690420.063449:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 468 00000100:00100000:2.0:1779690420.063459:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102405:x1866137503613696:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690420.063479:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690420.063499:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e698 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb3c expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063580:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063593:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063602:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063615:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063621:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063626:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063696:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063720:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063726:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063732:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690420.063735:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063742:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063755:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690420.063758:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.063762:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063768:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e69f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063780:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063785:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063791:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063795:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690420.063851:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063857:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063865:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x8c9b548f (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690420.063867:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.063869:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063874:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063901:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e698 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb3c expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063910:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690420.063912:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.063916:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e698 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb3c expref: 38 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.063924:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:2.0:1779690420.063980:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102405:x1866137503613696:12345-192.168.203.5@tcp:101:rm.0 Request processed in 523us (707us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690420.063986:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 468 00000100:00100000:1.0:1779690420.077468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.077599:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503613952 00000100:00100000:2.0:1779690420.077608:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503613952 00000100:00100000:2.0:1779690420.077667:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 469 00000100:00100000:2.0:1779690420.077677:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:102406:x1866137503613952:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1779690420.077706:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690420.077709:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690420.077733:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e691 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb35 expref: 37 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077750:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690420.077761:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690420.077774:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e6ad lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb43 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077928:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077941:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077951:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077963:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077970:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.077976:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690420.078658:0:64445:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ea:0x0], index 0: 0 00010000:00010000:2.0:1779690420.079703:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e6c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079725:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079735:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079773:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079780:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079786:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.079792:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690420.079796:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.082692:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.082718:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690420.082722:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690420.082727:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.082735:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e6b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690420.082755:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000978cee9c reply state 0000000096ee45c8 transno 12884902105 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690420.082781:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1779690420.087766:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e6ad lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb43 expref: 39 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690420.087802:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fe00/0xb4bb873a1913e6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb43 expref: 38 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690420.087837:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x17:0x0].0x0 (ffff9e2f826ec100) 00010000:00010000:1.0:1779690420.087841:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690420.087844:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fe00, rc 0) 00000100:00100000:1.0:1779690420.088036:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:102406:x1866137503613952:12345-192.168.203.5@tcp:101:dd.0 Request processed in 10358us (10573us total) trans 12884902105 rc 0/0 00000100:00100000:1.0:1779690420.088044:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 469 00010000:00010000:3.0:1779690420.091018:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091035:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091042:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091049:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690420.091053:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091060:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091089:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x8c9b548f (ffff9e2f826ece00) 00010000:00010000:3.0:1779690420.091092:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690420.091097:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.091102:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e6bb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690420.100667:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.100973:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614208 00000100:00100000:2.0:1779690420.100983:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614208 00000100:00100000:2.0:1779690420.101048:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1779690420.101060:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+38:102406:x1866137503614208:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690420.106732:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+39:102406:x1866137503614208:12345-192.168.203.5@tcp:35:dd.0 Request processed in 5665us (6064us total) trans 12884902106 rc 0/0 00000100:00100000:0.0:1779690420.106746:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1779690420.141438:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.141556:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614336 00000100:00100000:2.0:1779690420.141566:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614336 00000100:00100000:2.0:1779690420.141629:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 470 00000100:00100000:2.0:1779690420.141639:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:102408:x1866137503614336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690420.141680:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690420.141706:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e6d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb4a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141771:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141792:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141833:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141848:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141855:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690420.141861:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142077:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e6e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142086:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142092:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690420.142121:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7b:0x0]: returning size 512 00000004:00200000:3.0:1779690420.142125:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690420.142147:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142158:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142164:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142170:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142176:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690420.142187:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142195:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142206:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690420.142208:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690420.142212:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142218:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913e6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142229:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142235:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142240:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142244:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690420.142246:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142252:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142258:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab856785 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690420.142261:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690420.142269:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142275:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e6de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142305:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913e6d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb4a expref: 41 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142316:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53fc00/0xb4bb873a1913e6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb4a expref: 40 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690420.142323:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:3.0:1779690420.142325:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690420.142328:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53fc00, rc 0) 00000100:00100000:3.0:1779690420.142397:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:102408:x1866137503614336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 758us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690420.142404:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 470 00000001:00080000:3.0:1779690420.226182:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902103 is committed 00000001:00080000:3.0:1779690420.226200:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902106 is committed 00000001:00080000:3.0:1779690420.226208:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902104 is committed 00000001:00080000:3.0:1779690420.236113:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968403 is committed 00000100:00100000:2.0:1779690420.312527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690420.312641:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614592 00000100:00100000:0.0:1779690420.312657:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614592 00000100:00100000:0.0:1779690420.312714:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 471 00000100:00100000:0.0:1779690420.312724:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102434:x1866137503614592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690420.312744:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690420.312762:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e6ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb51 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312867:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312880:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312891:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312954:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312961:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.312983:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313330:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e701 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313339:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313346:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690420.313355:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690420.313515:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313523:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313528:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313533:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690420.313537:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313551:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313562:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690420.313565:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690420.313575:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313581:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e6f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313593:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313598:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313603:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313607:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690420.313609:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313613:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313620:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e308bf54600) 00010000:00010000:0.0:1779690420.313622:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690420.313624:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.313628:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e6fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.315588:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e6ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb51 expref: 40 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.315687:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e701 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb51 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690420.315696:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690420.315699:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690420.315703:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d800, rc 0) 00000100:00100000:0.0:1779690420.315835:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:102434:x1866137503614592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3111us (3316us total) trans 12884902107 rc 0/0 00000100:00100000:0.0:1779690420.315844:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 471 00000100:00100000:2.0:1779690420.321630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690420.321703:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614720 00000100:00100000:1.0:1779690420.321711:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614720 00000100:00100000:1.0:1779690420.321763:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18655 00000100:00100000:1.0:1779690420.321783:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+39:2391:x1866137503614720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690420.321797:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690420.321833:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e701 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb51 expref: 39 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690420.321851:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690420.321855:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690420.321904:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+38:2391:x1866137503614720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690420.321912:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18655 00000100:00100000:2.0:1779690420.323116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690420.323142:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614848 00000100:00100000:1.0:1779690420.323157:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614848 00000100:00100000:1.0:1779690420.323200:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 472 00000100:00100000:1.0:1779690420.323208:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+38:102434:x1866137503614848:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1779690420.323305:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+38:102434:x1866137503614848:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 98us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690420.323312:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 472 00000040:00080000:2.0:1779690420.489246:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690420.489254:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690420.489883:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:2.0:1779690420.489893:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690420.676555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.676652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.676676:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.676694:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690420.676714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690420.677718:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503614976 00000100:00100000:3.0:1779690420.677731:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503614976 00000100:00100000:3.0:1779690420.677845:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1779690420.677857:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503614976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690420.677926:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503614976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690420.677933:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:2.0:1779690420.679873:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615232 00000100:00100000:2.0:1779690420.679885:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615232 00000100:00100000:2.0:1779690420.679933:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615488 00000100:00100000:2.0:1779690420.679936:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615488 00000100:00100000:2.0:1779690420.679955:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615104 00000100:00100000:2.0:1779690420.679957:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615104 00000100:00100000:2.0:1779690420.679972:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615360 00000100:00100000:2.0:1779690420.679974:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615360 00000100:00100000:2.0:1779690420.679997:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2823 00000100:00100000:2.0:1779690420.680006:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503615232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690420.680063:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503615232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 58us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.680069:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2823 00000100:00100000:2.0:1779690420.680082:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2824 00000100:00100000:2.0:1779690420.680088:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+15:2389:x1866137503615488:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690420.680117:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+15:2389:x1866137503615488:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.680123:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2824 00000100:00100000:2.0:1779690420.680134:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2825 00000100:00100000:2.0:1779690420.680140:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503615104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690420.680161:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503615104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.680167:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2825 00000100:00100000:2.0:1779690420.680176:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2826 00000100:00100000:2.0:1779690420.680182:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503615360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690420.680200:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503615360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 19us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690420.680206:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2826 00000100:00080000:2.0:1779690420.680228:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690420.680232:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690420.681919:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690421.522267:0:64871:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690421.522275:0:64871:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690421.522802:0:64871:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690421.522835:0:64871:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690421.706560:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1779690422.122597:0:64919:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe87a0dca0 00000004:00000080:0.0:1779690422.122613:0:64919:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e3091cc3800 uarg=0000000000000000 00000004:00000080:0.0:1779690422.122650:0:64919:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e3091cc3800 00000040:00080000:0.0:1779690422.123132:0:64919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].3, 80 off8432 00000004:00000080:0.0:1779690422.123154:0:64919:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl3', mask 0x0 00000004:02000000:0.0:1779690422.123157:0:64919:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:2.0:1779690422.258447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690422.258576:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615616 00000100:00100000:0.0:1779690422.258585:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615616 00000100:00100000:0.0:1779690422.258655:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 473 00000100:00080000:2.0:1779690422.258662:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690422.258666:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+34:102481:x1866137503615616:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690422.258688:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690422.258708:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e70f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb58 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.258774:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.258787:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.259176:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690422.259400:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690422.259404:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 102 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690422.259478:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.259504:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483cc00/0xb4bb873a1913e70f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb58 expref: 36 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.259577:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb58 expref: 35 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.259585:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690422.259587:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690422.259591:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483da00, rc 0) 00000100:00100000:0.0:1779690422.259701:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+35:102481:x1866137503615616:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1036us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690422.259709:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 473 00000100:00100000:3.0:1779690422.261951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690422.263731:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615744 00000100:00100000:0.0:1779690422.263742:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615744 00000100:00100000:0.0:1779690422.263797:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 474 00000100:00100000:0.0:1779690422.263825:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+35:102481:x1866137503615744:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690422.263844:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690422.263861:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e71d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb5f expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263939:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263954:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263965:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263980:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263987:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.263994:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264388:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e732 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264399:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264406:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690422.264487:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7b:0x0]: returning size 7680 00000004:00200000:0.0:1779690422.264491:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690422.264594:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264618:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264623:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264629:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264635:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690422.264639:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264646:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264657:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690422.264660:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690422.264664:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264670:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264681:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264687:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264692:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264705:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690422.264708:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264714:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264722:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab856785 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690422.264724:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690422.264727:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264733:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e72b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab856785 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264764:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e71d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb5f expref: 37 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264776:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d600/0xb4bb873a1913e732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb5f expref: 36 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.264782:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:0.0:1779690422.264785:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690422.264787:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d600, rc 0) 00000100:00100000:0.0:1779690422.264875:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+36:102481:x1866137503615744:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1069us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690422.264883:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 474 00000100:00100000:2.0:1779690422.266586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690422.266690:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503615872 00000100:00100000:1.0:1779690422.266697:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503615872 00000100:00100000:1.0:1779690422.266748:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 475 00000100:00100000:1.0:1779690422.266758:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+36:102481:x1866137503615872:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690422.266776:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690422.266793:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e739 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb66 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.266986:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267008:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267018:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267031:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267038:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267043:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267347:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267354:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267359:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690422.267387:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x17:0x0]: returning size 0 00000004:00200000:1.0:1779690422.267390:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690422.267401:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267409:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267422:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267425:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267429:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267433:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690422.267435:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267439:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267447:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:1.0:1779690422.267449:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690422.267451:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267455:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e740 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267463:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267466:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267470:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267476:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690422.267478:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267481:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267485:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x8c9b548f (ffff9e2f903c9f00) 00010000:00010000:1.0:1779690422.267486:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690422.267488:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267491:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913e747 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x8c9b548f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267519:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913e739 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb66 expref: 38 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267541:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9800/0xb4bb873a1913e74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb66 expref: 37 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690422.267547:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x17:0x0].0x0 (ffff9e2f826ec100) 00010000:00010000:1.0:1779690422.267550:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690422.267552:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9800, rc 0) 00000100:00100000:1.0:1779690422.267612:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+37:102481:x1866137503615872:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 854us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690422.267619:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 475 00000100:00100000:2.0:1779690422.271410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690422.271475:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616000 00000100:00100000:0.0:1779690422.271495:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616000 00000100:00100000:0.0:1779690422.271582:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6396 00000100:00100000:0.0:1779690422.271593:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+16:2391:x1866137503616000:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690422.271610:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690422.271638:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f36fa89/0xb4bb873a1913e755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb6d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690422.271668:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1779690422.271686:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690422.271689:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690422.271696:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f36fa89/0xb4bb873a1913e755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb6d expref: 17 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.271711:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f36fa89/0xb4bb873a1913e755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb6d expref: 17 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.271727:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483cc00, rc 0) 00000100:00100000:0.0:1779690422.271778:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503616000:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 187us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690422.271785:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6396 00000100:00080000:2.0:1779690422.271875:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690422.274680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690422.275012:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616128 00000100:00100000:0.0:1779690422.275021:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616128 00000100:00100000:0.0:1779690422.275075:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 476 00000100:00100000:0.0:1779690422.275084:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+37:102481:x1866137503616128:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690422.275102:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690422.275121:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e75c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb74 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275196:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e763 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275209:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275220:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690422.275395:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7b:0x0]: returning size 7680 00000004:00200000:0.0:1779690422.275400:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690422.275472:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275498:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e75c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb74 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275535:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c600/0xb4bb873a1913e763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb74 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690422.275544:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7b:0x0].0x0 (ffff9e2f883cb600) 00010000:00010000:0.0:1779690422.275547:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690422.275550:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483c600, rc 0) 00000100:00100000:0.0:1779690422.275617:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+38:102481:x1866137503616128:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 533us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690422.275624:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 476 00000100:00100000:1.0:1779690422.280373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690422.280448:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616384 00000100:00100000:2.0:1779690422.280458:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616384 00000100:00100000:2.0:1779690422.280556:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 477 00000100:00100000:2.0:1779690422.280566:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+38:102481:x1866137503616384:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690422.281153:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].22, 136 off11184 00000100:00100000:2.0:1779690422.281238:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+38:102481:x1866137503616384:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 673us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690422.281246:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 477 00000040:00080000:2.0:1779690422.537036:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690422.537043:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690422.537369:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 23 count 11 00000040:00080000:2.0:1779690422.537376:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690422.537770:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492311168:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690422.537898:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690422.548405:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492311168:192.168.203.5@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1779690422.729075:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690422.867298:0:64968:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690422.867307:0:64968:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690422.867377:0:64968:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 23 count 11 00000040:00080000:3.0:1779690422.867383:0:64968:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690422.917885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690422.918196:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616640 00000100:00100000:2.0:1779690422.918205:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616640 00000100:00100000:2.0:1779690422.918257:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 478 00000100:00100000:2.0:1779690422.918266:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+38:102491:x1866137503616640:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690422.918391:0:64445:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690422.918396:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690422.918427:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 23 count 11 00000040:00080000:2.0:1779690422.918433:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690422.919423:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].23, 136 off11320 00000100:00100000:2.0:1779690422.919509:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+38:102491:x1866137503616640:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1241us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690422.919765:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 478 00000100:00100000:3.0:1779690423.241158:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690423.241224:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690423.241291:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690423.241298:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690423.241323:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690423.241356:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311424 00000100:00100000:3.0:1779690423.241363:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311424 00000100:00100000:3.0:1779690423.241410:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311296 00000100:00100000:3.0:1779690423.241413:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311296 00000100:00100000:3.0:1779690423.241432:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1779690423.241439:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492311424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690423.241472:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690423.241512:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492311424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690423.241529:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1779690423.241566:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1779690423.241573:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492311296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690423.241593:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690423.241622:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492311296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690423.241629:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00080000:3.0:1779690423.241644:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690423.241648:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690423.241679:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690423.241690:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968403 gen 2 00000004:00080000:3.0:1779690423.241695:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e30888f8000, transno 4294968403 00000100:00100000:3.0:1779690423.241707:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690423.242584:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492311552:0@lo:400:kworker.0 00000100:00100000:3.0:1779690423.242622:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690423.243698:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492311936:0@lo:400:kworker.0 00000100:00100000:2.0:1779690423.243738:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690423.243783:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690423.243790:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492311808:0@lo:400:kworker.0 00000100:00100000:2.0:1779690423.243844:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690423.243871:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311936 00000100:00100000:2.0:1779690423.243876:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311936 00000100:00100000:2.0:1779690423.243906:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311808 00000100:00100000:2.0:1779690423.243908:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311808 00000100:00100000:2.0:1779690423.243929:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1779690423.243935:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492311936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690423.243975:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492311936:12345-0@lo:400:kworker.0 Request processed in 40us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690423.243981:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1779690423.243996:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1779690423.244002:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492311808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690423.244028:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492311808:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690423.244033:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1779690423.244067:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492311808:0@lo:400:kworker.0 00000100:00100000:2.0:1779690423.244077:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492311936:0@lo:400:kworker.0 00000100:00080000:2.0:1779690423.244110:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690423.245606:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690423.245617:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492311680:0@lo:400:kworker.0 00000100:00100000:3.0:1779690423.245657:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690423.245689:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311680 00000100:00100000:3.0:1779690423.245695:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311680 00000100:00100000:3.0:1779690423.245734:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1779690423.245742:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492311680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690423.245785:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492311680:12345-0@lo:400:kworker.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690423.245792:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1779690423.245826:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690423.245847:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492311680:0@lo:400:kworker.0 00000100:00100000:0.0:1779690423.245954:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492311552 00000100:00100000:0.0:1779690423.245964:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492311552 00000100:00100000:0.0:1779690423.245991:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1779690423.245997:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492311552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690423.246033:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492311552:12345-0@lo:400:kworker.0 Request processed in 36us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690423.246039:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1779690423.246117:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492311552:0@lo:400:kworker.0 00000040:00080000:1.0:1779690423.529453:0:65019:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690423.529461:0:65019:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690423.534980:0:65019:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 24 count 12 00000040:00080000:1.0:1779690423.534991:0:65019:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690423.563312:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690423.563319:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690423.563357:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 24 count 12 00000040:00080000:0.0:1779690423.563365:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690423.563524:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492312064:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690423.563615:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90821cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690423.573111:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492312064:192.168.203.5@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1779690423.753051:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690424.777432:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690425.141393:0:65070:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690425.141403:0:65070:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690425.141485:0:65070:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 24 count 12 00000040:00080000:1.0:1779690425.141493:0:65070:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690425.236675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.236772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.236919:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616768 00000100:00100000:2.0:1779690425.236928:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616768 00000100:00100000:2.0:1779690425.237018:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503616896 00000100:00100000:2.0:1779690425.237022:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503616896 00000100:00100000:2.0:1779690425.237046:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 479 00000100:00100000:2.0:1779690425.237056:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:102516:x1866137503616768:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1779690425.237067:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 480 00000100:00100000:1.0:1779690425.237081:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:102515:x1866137503616896:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690425.237086:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x17:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1779690425.237100:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x17:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1779690425.237268:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690425.237406:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:102515:x1866137503616896:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 329us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.237412:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:102516:x1866137503616768:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 355us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690425.237421:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 480 00000100:00100000:2.0:1779690425.237724:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 479 00000100:00100000:1.0:1779690425.241720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.243691:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503617152 00000100:00100000:3.0:1779690425.243703:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503617152 00000100:00100000:3.0:1779690425.243769:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 481 00000100:00100000:3.0:1779690425.243780:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+38:102515:x1866137503617152:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690425.243802:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690425.243839:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e76a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb7b expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.243937:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e771 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.243953:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.243965:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690425.243990:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x17:0x0]: returning size 0 00010000:00010000:3.0:1779690425.244119:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e76a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb7b expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.244138:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb7b expref: 40 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.244161:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x17:0x0].0x0 (ffff9e2f826ec100) 00010000:00010000:3.0:1779690425.244164:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690425.244168:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53ee00, rc 0) 00000100:00100000:3.0:1779690425.244238:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:102515:x1866137503617152:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 461us (2526us total) trans 12884902108 rc 0/0 00000100:00100000:3.0:1779690425.244245:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 481 00000100:00100000:3.0:1779690425.247120:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.247346:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503617408 00000100:00100000:2.0:1779690425.247354:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503617408 00000100:00100000:2.0:1779690425.247420:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18656 00000100:00100000:2.0:1779690425.247430:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+40:2391:x1866137503617408:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690425.247446:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690425.247470:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e771 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb7b expref: 40 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.247487:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x17:0x0].0x0 (ffff9e2f826ec100) 00010000:00010000:2.0:1779690425.247491:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690425.247558:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+39:2391:x1866137503617408:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 124us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.247566:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18656 00000100:00100000:2.0:1779690425.255304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.255587:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503617280 00000100:00100000:3.0:1779690425.255597:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503617280 00000100:00100000:3.0:1779690425.255712:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6397 00000100:00100000:3.0:1779690425.255725:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503617280:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690425.255772:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255789:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690425.255791:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690425.255796:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255833:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255865:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255873:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255890:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.255898:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690425.255902:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.256646:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.256665:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690425.256674:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e818418/0xb4bb873a1913e77f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690425.256752:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503617280:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 1029us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.256761:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6397 00000100:00080000:3.0:1779690425.256792:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690425.260241:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.260628:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503617664 00000100:00100000:2.0:1779690425.260637:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503617664 00000100:00100000:2.0:1779690425.260751:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 482 00000100:00100000:2.0:1779690425.260761:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:102515:x1866137503617664:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690425.260904:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:102515:x1866137503617664:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 145us (671us total) trans 0 rc -125/-125 00000100:00100000:2.0:1779690425.260911:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 482 00000100:00100000:3.0:1779690425.264183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.264211:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503617920 00000100:00100000:3.0:1779690425.264220:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503617920 00000100:00100000:3.0:1779690425.264267:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:3.0:1779690425.264282:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90558050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+39:102515:x1866137503617920:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690425.265089:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90558050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+40:102515:x1866137503617920:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 807us (911us total) trans 12884902109 rc 0/0 00000100:00100000:3.0:1779690425.265097:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:3.0:1779690425.267703:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.267867:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618176 00000100:00100000:2.0:1779690425.267875:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618176 00000100:00100000:2.0:1779690425.267928:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 483 00000100:00100000:2.0:1779690425.267937:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:102515:x1866137503618176:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690425.268019:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268036:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268049:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268636:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268646:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268653:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.268659:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690425.268664:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.269190:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.269206:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x17:0x0].0x0 (ffff9e2f826ec100) 00010000:00010000:2.0:1779690425.269209:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690425.269214:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690425.269230:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913e786 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690425.269883:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:102515:x1866137503618176:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 1944us (2184us total) trans 12884902110 rc 0/0 00000100:00100000:2.0:1779690425.269893:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 483 00000040:00080000:0.0:1779690425.271896:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690425.271903:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690425.272966:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:0.0:1779690425.272978:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:00080000:3.0:1779690425.333130:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902107 is committed 00000001:00080000:3.0:1779690425.333152:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902110 is committed 00000100:00100000:3.0:1779690425.794191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.794279:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618432 00000100:00100000:2.0:1779690425.794288:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618432 00000100:00100000:2.0:1779690425.794383:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:2.0:1779690425.794394:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:2391:x1866137503618432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690425.794485:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:2391:x1866137503618432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.794499:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:1.0:1779690425.794724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690425.794757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690425.794785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690425.794801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.794841:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618688 00000100:00100000:3.0:1779690425.794846:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618688 00000100:00100000:1.0:1779690425.794853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.794887:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618944 00000100:00100000:3.0:1779690425.794891:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618944 00000100:00100000:1.0:1779690425.794897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.794918:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618560 00000100:00100000:3.0:1779690425.794922:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618560 00000100:00100000:1.0:1779690425.794938:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619072 00000100:00100000:1.0:1779690425.794943:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619072 00000100:00100000:3.0:1779690425.794959:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2827 00000100:00100000:3.0:1779690425.794977:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503618688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690425.794984:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2828 00000100:00100000:1.0:1779690425.794994:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503618944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690425.795015:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503618688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.795022:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2827 00000100:00100000:1.0:1779690425.795032:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503618944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.795040:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2829 00000100:00100000:3.0:1779690425.795049:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503618560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690425.795057:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2828 00000100:00100000:3.0:1779690425.795076:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503618560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.795082:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2829 00000100:00100000:3.0:1779690425.795094:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2830 00000100:00100000:3.0:1779690425.795100:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503619072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690425.795128:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503619072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.795135:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2830 00000100:00080000:3.0:1779690425.795153:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690425.795156:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690425.795482:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618304 00000100:00100000:2.0:1779690425.795497:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618304 00000100:00100000:2.0:1779690425.795528:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:2.0:1779690425.795535:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503618304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690425.795568:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503618304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.795574:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:2.0:1779690425.795598:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503618816 00000100:00100000:2.0:1779690425.795602:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503618816 00000100:00100000:2.0:1779690425.795632:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:2.0:1779690425.795638:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+38:2392:x1866137503618816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690425.795666:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+38:2392:x1866137503618816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.795679:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00080000:2.0:1779690425.795878:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1779690425.799531:0:65122:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690425.799538:0:65122:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690425.799626:0:65122:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 24 count 12 00000040:00080000:1.0:1779690425.799633:0:65122:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690425.802082:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690425.851407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.851686:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619200 00000100:00100000:2.0:1779690425.851696:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619200 00000100:00100000:2.0:1779690425.851755:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 484 00000100:00100000:2.0:1779690425.851765:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619200:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690425.852000:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619200:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 235us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.852008:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 484 00000100:00100000:2.0:1779690425.858230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690425.858302:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619328 00000100:00100000:1.0:1779690425.858311:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619328 00000100:00100000:1.0:1779690425.858455:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 485 00000100:00100000:1.0:1779690425.858466:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619328:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1779690425.858728:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690425.858862:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619328:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 397us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690425.858870:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 485 00000100:00100000:2.0:1779690425.867788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.868100:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619456 00000100:00100000:3.0:1779690425.868108:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619456 00000100:00100000:3.0:1779690425.868173:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 486 00000100:00100000:3.0:1779690425.868183:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619456:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690425.868345:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690425.868423:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619456:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 242us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.868431:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 486 00000100:00100000:2.0:1779690425.871943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.872073:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619584 00000100:00100000:3.0:1779690425.872082:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619584 00000100:00100000:3.0:1779690425.872160:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 487 00000100:00100000:3.0:1779690425.872170:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619584:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690425.872313:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690425.872389:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619584:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 221us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.872397:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 487 00000100:00100000:0.0:1779690425.876945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.877030:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619712 00000100:00100000:2.0:1779690425.877040:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619712 00000100:00100000:2.0:1779690425.877092:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 488 00000100:00100000:2.0:1779690425.877103:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619712:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690425.877216:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619712:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.877224:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 488 00000100:00100000:1.0:1779690425.881582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.881628:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619840 00000100:00100000:3.0:1779690425.881638:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619840 00000100:00100000:3.0:1779690425.881736:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 489 00000100:00100000:3.0:1779690425.881749:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619840:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690425.881976:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619840:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 229us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.881986:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 489 00000100:00100000:0.0:1779690425.886956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690425.887185:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503619968 00000100:00100000:3.0:1779690425.887195:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503619968 00000100:00100000:3.0:1779690425.887262:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 490 00000100:00100000:3.0:1779690425.887274:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619968:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690425.887451:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503619968:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 180us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690425.887460:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 490 00000100:00100000:0.0:1779690425.891753:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690425.891843:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620096 00000100:00100000:2.0:1779690425.891853:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620096 00000100:00100000:2.0:1779690425.891899:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 491 00000100:00100000:2.0:1779690425.891908:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503620096:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690425.893264:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+37:102531:x1866137503620096:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 1351us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690425.893283:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 491 00010000:00010000:0.0:1779690426.827572:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690427.849006:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690428.361262:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492312320:0@lo:400:kworker.0 00000100:00100000:1.0:1779690428.361342:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690428.361963:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492312448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690428.362000:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690428.362039:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312448 00000100:00100000:0.0:1779690428.362058:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312448 00000100:00100000:0.0:1779690428.362108:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1779690428.362116:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492312448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690428.362147:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690428.362184:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492312448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690428.362191:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:0.0:1779690428.362209:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690428.362228:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492312576:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.362253:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690428.362271:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312576 00000100:00100000:0.0:1779690428.362275:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312576 00000100:00100000:0.0:1779690428.362314:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1779690428.362320:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492312576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.362534:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492312576:12345-0@lo:400:kworker.0 Request processed in 214us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690428.362541:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1779690428.362557:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690428.362577:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492312704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.362599:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690428.362618:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312704 00000100:00100000:0.0:1779690428.362621:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312704 00000100:00100000:0.0:1779690428.362643:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1779690428.362648:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492312704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.362674:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492312704:12345-0@lo:400:kworker.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690428.362680:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1779690428.362700:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690428.363769:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492312192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690428.363838:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690428.363875:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312192 00000100:00100000:1.0:1779690428.363880:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312192 00000100:00100000:1.0:1779690428.363934:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1779690428.363949:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492312192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690428.363982:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690428.364032:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492312192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690428.364046:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492312448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690428.364055:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1779690428.364072:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1779690428.364074:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690428.364081:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492312832:0@lo:400:kworker.0 00000100:00100000:1.0:1779690428.364106:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492312192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690428.364114:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690428.364153:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312832 00000100:00100000:0.0:1779690428.364156:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312832 00000100:00100000:1.0:1779690428.364184:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492312576:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.364191:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1779690428.364199:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492312832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690428.364234:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492312704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.364241:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492312832:12345-0@lo:400:kworker.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690428.364247:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1779690428.364276:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492312832:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.364455:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492312960:0@lo:400:kworker.0 00000100:00100000:0.0:1779690428.364497:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690428.364525:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312960 00000100:00100000:1.0:1779690428.364531:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312960 00000100:00100000:1.0:1779690428.364687:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1779690428.364698:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492312960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690428.364738:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492312960:12345-0@lo:400:kworker.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690428.365849:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492312320 00000100:00100000:3.0:1779690428.365995:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492312320 00000100:00100000:3.0:1779690428.366032:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1779690428.366039:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492312320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690428.366093:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492312320:12345-0@lo:400:kworker.0 Request processed in 54us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690428.366099:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1779690428.366166:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492312960:0@lo:400:kworker.0 00000100:00100000:3.0:1779690428.366203:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492312320:0@lo:400:kworker.0 00000100:00100000:1.0:1779690428.366576:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00010000:0.0:1779690428.873384:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690429.444028:0:65319:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690429.444034:0:65319:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690429.444077:0:65319:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 4 count 2 00000040:00080000:3.0:1779690429.444083:0:65319:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690429.486002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690429.486072:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620224 00000100:00100000:0.0:1779690429.486081:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620224 00000100:00100000:0.0:1779690429.486146:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 492 00000100:00100000:0.0:1779690429.486156:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:102973:x1866137503620224:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690429.486196:0:57559:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b3996b38 uarg=0000000000000000 00000004:00000080:0.0:1779690429.486228:0:57559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b3996b38 00000004:00000080:0.0:1779690429.486234:0:57559:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=3, endrec=0 00000040:00080000:0.0:1779690429.486313:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690429.486318:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690429.486350:0:57559:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl3 endrec = 8 00000040:00080000:0.0:1779690429.486470:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 4 count 2 00000040:00080000:0.0:1779690429.486477:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690429.486481:0:57559:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl3 entries up to 18446744073709551615 00000040:00080000:0.0:1779690429.486510:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690429.486513:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690429.486839:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 8 count 1 00000040:00080000:0.0:1779690429.486844:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690429.486926:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+37:102973:x1866137503620224:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 771us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690429.486935:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 492 00000100:00080000:2.0:1779690429.489540:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690429.897074:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1779690430.098250:0:65367:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fffab37e840 00000004:00000080:1.0:1779690430.098265:0:65367:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e30aee5ec00 uarg=0000000000000000 00000004:00000080:1.0:1779690430.098303:0:65367:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e30aee5ec00 00000004:00000080:1.0:1779690430.098309:0:65367:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=3, endrec=0 00000040:00080000:1.0:1779690430.098402:0:65367:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690430.098407:0:65367:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690430.098436:0:65367:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl3 endrec = 8 00000040:00080000:1.0:1779690430.098512:0:65367:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 4 count 2 00000040:00080000:1.0:1779690430.098518:0:65367:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690430.098547:0:65367:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl3 entries up to 18446744073709551615 00000040:00080000:1.0:1779690430.098590:0:65367:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690430.098593:0:65367:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690430.099229:0:65367:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690430.099236:0:65367:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:1.0:1779690430.099263:0:65367:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=3 00000040:00080000:1.0:1779690430.099307:0:65367:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690430.099310:0:65367:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690430.099529:0:65367:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 3 count 1 00000040:00080000:1.0:1779690430.099534:0:65367:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690430.099552:0:65367:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1779690430.099554:0:65367:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1779690430.102939:0:65367:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl3 record=18446744073709551615 00000040:00080000:0.0:1779690430.103198:0:65367:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690430.103203:0:65367:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690430.103770:0:65367:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:0.0:1779690430.103779:0:65367:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:0.0:1779690430.104208:0:65367:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690430.104211:0:65367:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690430.104664:0:65367:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690430.104671:0:65367:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:3.0:1779690430.737561:0:65417:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690430.737576:0:65417:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690430.739455:0:65417:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690430.739470:0:65417:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690430.831494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690430.832731:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620352 00000100:00100000:1.0:1779690430.832742:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620352 00000100:00100000:0.0:1779690430.837425:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 493 00000100:00100000:0.0:1779690430.837449:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:102434:x1866137503620352:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1779690430.837562:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+37:102434:x1866137503620352:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 127us (6075us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.837570:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 493 00000100:00100000:0.0:1779690430.839452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690430.839483:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620608 00000100:00100000:0.0:1779690430.839492:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620608 00000100:00100000:0.0:1779690430.839530:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:0.0:1779690430.840671:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+37:102434:x1866137503620608:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690430.846203:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+38:102434:x1866137503620608:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 5531us (6760us total) trans 12884902111 rc 0/0 00000100:00100000:0.0:1779690430.846217:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:0.0:1779690430.916098:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690430.916144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690430.916178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690430.916242:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620736 00000100:00100000:0.0:1779690430.916247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690430.916254:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620736 00000100:00100000:0.0:1779690430.916277:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620864 00000100:00100000:0.0:1779690430.916282:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620864 00000100:00100000:0.0:1779690430.916324:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503620992 00000100:00100000:0.0:1779690430.916327:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503620992 00000100:00100000:0.0:1779690430.916346:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621248 00000100:00100000:0.0:1779690430.916348:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621248 00000100:00100000:2.0:1779690430.916363:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:2.0:1779690430.916375:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503620736:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690430.916378:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2832 00000100:00100000:0.0:1779690430.916391:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503620864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690430.916481:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2833 00000100:00100000:2.0:1779690430.916511:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503620736:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 138us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690430.916520:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00080000:2.0:1779690430.916549:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690430.916553:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690430.916648:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503620992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690430.916917:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2834 00000100:00100000:3.0:1779690430.916927:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503621248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690430.917086:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503620864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 697us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.917093:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2832 00000100:00100000:2.0:1779690430.917131:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690430.917148:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621120 00000100:00100000:0.0:1779690430.917153:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621120 00000100:00100000:0.0:1779690430.917186:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:0.0:1779690430.917192:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+38:2392:x1866137503621120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690430.917218:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+38:2392:x1866137503621120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.917224:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00080000:0.0:1779690430.917250:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690430.917352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690430.917505:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621376 00000100:00100000:0.0:1779690430.917509:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621376 00000100:00100000:0.0:1779690430.917574:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2835 00000100:00100000:0.0:1779690430.917580:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503621376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690430.917610:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503621376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.917616:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2835 00000100:00080000:2.0:1779690430.918028:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690430.921423:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690430.923173:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503620992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6672us (6983us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.923187:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2833 00000100:00100000:0.0:1779690430.923821:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503621248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6876us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690430.923831:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2834 00010000:00010000:0.0:1779690431.945474:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690432.084005:0:65466:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222a: Changelog for explicit restore == 02:27:10 (1779690430) 00000100:00100000:2.0:1779690432.340559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.341740:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621632 00000100:00100000:0.0:1779690432.341750:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621632 00000100:00100000:0.0:1779690432.341864:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 494 00000100:00100000:0.0:1779690432.341882:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+38:103174:x1866137503621632:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690432.341906:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.341924:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e78d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb82 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.341989:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342003:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342025:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342049:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342057:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342064:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342445:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342455:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342462:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.342472:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690432.342613:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342622:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342628:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342633:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.342643:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342650:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342661:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690432.342664:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.342668:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342674:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342686:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342692:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342697:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342702:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.342705:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342710:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342717:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.342720:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.342729:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.342735:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e79b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690432.342755:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690432.343098:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e78d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb82 expref: 41 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.343113:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb82 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.343120:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690432.343122:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.343125:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690432.343186:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:103174:x1866137503621632:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1314us (2637us total) trans 12884902112 rc 0/0 00000100:00100000:0.0:1779690432.343194:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 494 00000100:00100000:1.0:1779690432.346179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690432.346260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.346335:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621760 00000100:00100000:0.0:1779690432.346344:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621760 00000100:00100000:0.0:1779690432.346403:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18657 00000100:00100000:0.0:1779690432.346412:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+40:2391:x1866137503621760:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690432.346435:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690432.346456:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb82 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.346474:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690432.346479:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690432.346539:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+39:2391:x1866137503621760:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.346545:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18657 00000100:00100000:2.0:1779690432.346690:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503621888 00000100:00100000:2.0:1779690432.346694:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503621888 00000100:00100000:2.0:1779690432.346730:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 495 00000100:00100000:2.0:1779690432.346738:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:103174:x1866137503621888:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690432.346840:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:103174:x1866137503621888:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 102us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690432.346847:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 495 00000100:00100000:1.0:1779690432.355709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.355783:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622016 00000100:00100000:0.0:1779690432.355793:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622016 00000100:00100000:0.0:1779690432.355888:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 496 00000100:00100000:0.0:1779690432.355898:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+38:103175:x1866137503622016:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690432.355917:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.355937:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb89 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.355996:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356007:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356014:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356037:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356044:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356050:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356301:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356319:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356325:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356330:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.356334:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356342:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356352:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690432.356355:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.356360:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356366:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356379:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356385:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356390:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356394:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.356404:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356411:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356419:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc4e44f (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.356430:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.356434:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356440:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356471:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb89 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356481:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690432.356483:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.356487:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb89 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.356496:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d000, rc 0) 00000100:00100000:0.0:1779690432.356561:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+38:103175:x1866137503622016:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 664us (860us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690432.356569:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 496 00000100:00080000:2.0:1779690432.356707:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690432.361271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.361347:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622272 00000100:00100000:0.0:1779690432.361356:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622272 00000100:00100000:0.0:1779690432.361443:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 497 00000100:00100000:0.0:1779690432.361452:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+38:103175:x1866137503622272:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690432.361510:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690432.361533:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e716 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb58 expref: 38 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.361551:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690432.361555:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690432.361800:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.362004:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.362014:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.362053:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 38 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.362066:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 38 pid: 57559 timeout: 3259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690432.362079:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492313088:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690432.362149:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308d71fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690432.364767:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492313088:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690432.364791:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690432.365794:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690432.366315:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622400 00000100:00100000:3.0:1779690432.366322:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622400 00010000:00010000:3.0:1779690432.366357:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 39 pid: 57559 timeout: 3259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690432.366450:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3224 00000100:00100000:3.0:1779690432.366460:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+39:2391:x1866137503622400:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690432.366475:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690432.366482:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 39 pid: 57559 timeout: 3259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366494:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 39 pid: 57559 timeout: 3259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366514:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e675 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb2e expref: 39 pid: 57559 timeout: 3259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366732:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690432.366738:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366763:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366770:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.366884:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690432.366931:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+38:2391:x1866137503622400:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 472us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690432.366938:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3224 00010000:00010000:0.0:1779690432.368091:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.368112:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.368134:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.368144:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.368153:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.370110:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7c:0x0]: returning size 512 00010000:00010000:0.0:1779690432.370125:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370134:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370140:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370146:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.370150:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370157:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370171:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690432.370174:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.370185:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.370191:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690432.370210:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000af50c242 reply state 00000000ddd86307 transno 12884902113 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690432.370219:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690432.370339:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:103175:x1866137503622272:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 8886us (9073us total) trans 12884902113 rc 0/0 00000100:00100000:0.0:1779690432.370345:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 497 00010000:00010000:3.0:1779690432.372041:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372053:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372060:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372066:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690432.372070:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372077:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372089:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc4e44f (ffff9e308bf54e00) 00010000:00010000:3.0:1779690432.372092:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690432.372095:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.372115:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e7cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1779690432.457061:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690432.457069:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690432.457439:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 24 count 10 00000040:00080000:3.0:1779690432.457446:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690432.605589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.605846:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622528 00000100:00100000:0.0:1779690432.605856:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622528 00000100:00100000:0.0:1779690432.605969:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 498 00000100:00100000:0.0:1779690432.605980:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+38:103212:x1866137503622528:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690432.606014:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.606034:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb90 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606096:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606110:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606121:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.606177:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690432.606192:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 103 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.606221:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606250:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb90 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606270:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb90 expref: 39 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.606278:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.606281:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690432.606285:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483da00, rc 0) 00000100:00100000:0.0:1779690432.606346:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+39:103212:x1866137503622528:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 368us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.606354:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 498 00000100:00100000:1.0:1779690432.609998:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.610880:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622784 00000100:00100000:0.0:1779690432.610890:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622784 00000100:00100000:0.0:1779690432.611067:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 499 00000100:00100000:0.0:1779690432.611079:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+39:103212:x1866137503622784:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:0.0:1779690432.611126:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690432.611148:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb90 expref: 39 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.611166:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.611176:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690432.611333:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+38:103212:x1866137503622784:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 257us (1340us total) trans 0 rc -17/-17 00000100:00100000:0.0:1779690432.611355:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 499 00000100:00100000:3.0:1779690432.615917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.616065:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503622912 00000100:00100000:0.0:1779690432.616073:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503622912 00000100:00100000:0.0:1779690432.616128:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 500 00000100:00100000:0.0:1779690432.616138:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+38:103212:x1866137503622912:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690432.616168:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.616189:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb97 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616248:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616262:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616273:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.616328:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690432.616331:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 103 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.616353:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616375:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb97 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616404:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb97 expref: 39 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.616435:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690432.616439:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690432.616442:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d000, rc 0) 00000100:00100000:0.0:1779690432.616491:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:103212:x1866137503622912:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 354us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.616499:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 500 00000100:00100000:1.0:1779690432.619131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.619487:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503623040 00000100:00100000:0.0:1779690432.619495:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503623040 00000100:00100000:0.0:1779690432.619551:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 501 00000100:00100000:0.0:1779690432.619707:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+39:103212:x1866137503623040:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690432.619726:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.619742:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedb9e expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619797:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619895:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619906:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619920:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619927:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.619947:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620103:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620112:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620119:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.620158:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7c:0x0]: returning size 512 00000004:00200000:0.0:1779690432.620162:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.620183:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620195:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620201:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620207:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620213:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.620218:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620225:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620242:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690432.620245:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.620250:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620256:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620268:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620275:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620281:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620286:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.620288:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620294:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620302:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc4e44f (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.620304:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.620306:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620312:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e7fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620351:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb9e expref: 41 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620364:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb9e expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.620372:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:0.0:1779690432.620374:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690432.620377:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ce00, rc 0) 00000100:00100000:0.0:1779690432.620570:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+40:103212:x1866137503623040:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 867us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.620586:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 501 00000100:00100000:1.0:1779690432.657250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.657462:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503623168 00000100:00100000:0.0:1779690432.657472:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503623168 00000100:00100000:0.0:1779690432.657532:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 502 00000100:00100000:0.0:1779690432.657551:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+38:103218:x1866137503623168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690432.657572:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.657596:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e80b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedba5 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.657658:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.657673:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.657685:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.657760:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690432.657765:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 103 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.657789:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.657999:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e80b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 40 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.658017:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.658026:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690432.658028:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690432.658032:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483da00, rc 0) 00000100:00100000:0.0:1779690432.658123:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:103218:x1866137503623168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 582us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.658132:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 502 00000100:00100000:1.0:1779690432.673566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690432.673725:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503623424 00000100:00100000:2.0:1779690432.673746:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503623424 00000100:00100000:2.0:1779690432.673826:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 503 00000100:00100000:2.0:1779690432.673839:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+40:103218:x1866137503623424:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690432.673858:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690432.673864:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690432.673888:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e804 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb9e expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.673907:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:2.0:1779690432.673917:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690432.673932:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e819 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbac expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674070:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674083:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674092:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674147:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674156:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674163:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674718:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674729:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674736:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690432.674746:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e:0x0]: returning size 0 00010000:00010000:2.0:1779690432.674767:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674773:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674780:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674786:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690432.674790:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674796:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674826:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690432.674830:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690432.674834:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674851:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913e820 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690432.674863:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009a334eb4 reply state 00000000469f0cea transno 12884902114 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690432.674871:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690432.674897:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913e819 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674913:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690432.674920:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690432.674922:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690432.674924:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f200, rc 0) 00000100:00100000:2.0:1779690432.674988:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+42:103218:x1866137503623424:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1430us total) trans 12884902114 rc 0/0 00000100:00100000:2.0:1779690432.674996:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 503 00010000:00010000:3.0:1779690432.677414:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677438:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677445:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677452:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690432.677456:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677463:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677478:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0xee703f54 (ffff9e2f826ec400) 00010000:00010000:3.0:1779690432.677482:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690432.677486:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.677492:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e827 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690432.678208:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.678278:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503623680 00000100:00100000:0.0:1779690432.678287:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503623680 00000100:00100000:0.0:1779690432.678331:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 504 00000100:00100000:0.0:1779690432.678340:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+41:103218:x1866137503623680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690432.678360:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.678377:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e83c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbb3 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.678475:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.678500:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.678509:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.678540:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.678552:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 42 pid: 57559 timeout: 3260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690432.678566:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492313216:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690432.678686:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308d71f480 going to sleep for 11 seconds 00000100:00100000:0.0:1779690432.684130:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492313216:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690432.684158:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690432.685067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690432.685125:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503623808 00000100:00100000:3.0:1779690432.685131:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503623808 00010000:00010000:3.0:1779690432.685163:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 43 pid: 57559 timeout: 3260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690432.685200:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3225 00000100:00100000:3.0:1779690432.685208:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+43:2391:x1866137503623808:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690432.685221:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690432.685227:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 43 pid: 57559 timeout: 3260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685238:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 43 pid: 57559 timeout: 3260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685258:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913e82e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbac expref: 43 pid: 57559 timeout: 3260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685272:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690432.685317:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685327:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685335:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.685368:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690432.685442:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+42:2391:x1866137503623808:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 234us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690432.685450:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3225 00010000:00010000:1.0:1779690432.685639:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685647:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690432.685676:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e:0x0]: returning size 0 00010000:00010000:1.0:1779690432.685941:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685950:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685956:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685962:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690432.685966:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685973:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685981:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:1.0:1779690432.685984:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690432.685987:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.685992:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e843 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.686043:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e83c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbb3 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.686052:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54200) 00010000:00010000:1.0:1779690432.686054:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690432.686064:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e83c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbb3 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.686078:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483d400, rc 0) 00000100:00100000:1.0:1779690432.686111:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+41:103218:x1866137503623680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 7772us (7905us total) trans 12884902115 rc 301/301 00000100:00100000:1.0:1779690432.686117:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 504 00000100:00100000:1.0:1779690432.688542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690432.688702:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503624064 00000100:00100000:3.0:1779690432.688710:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503624064 00000100:00100000:3.0:1779690432.688836:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:3.0:1779690432.688849:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+41:103218:x1866137503624064:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690432.689289:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+42:103218:x1866137503624064:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 442us (751us total) trans 12884902116 rc 0/0 00000100:00100000:3.0:1779690432.689297:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:0.0:1779690432.692527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690432.692604:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503624192 00000100:00100000:1.0:1779690432.692612:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503624192 00000100:00100000:1.0:1779690432.692664:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 505 00000100:00100000:1.0:1779690432.692673:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+42:103218:x1866137503624192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690432.692695:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690432.692717:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e851 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbba expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.692772:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e851 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbba expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.692787:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e851 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbba expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.692833:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:1.0:1779690432.692836:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690432.692839:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690432.692887:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+43:103218:x1866137503624192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 216us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690432.692909:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 505 00000100:00100000:2.0:1779690432.696364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.696471:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503624448 00000100:00100000:0.0:1779690432.696480:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503624448 00000100:00100000:0.0:1779690432.696535:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 506 00000100:00100000:0.0:1779690432.696545:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+43:103218:x1866137503624448:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1779690432.696602:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696619:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696641:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696872:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696880:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696886:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696892:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.696897:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696903:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696915:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:0.0:1779690432.696918:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1779690432.696922:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.696928:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e858 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690432.696990:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+44:103218:x1866137503624448:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 447us (633us total) trans 12884902117 rc 0/0 00000100:00100000:0.0:1779690432.696998:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 506 00000100:00100000:3.0:1779690432.698681:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690432.698851:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503624704 00000100:00100000:1.0:1779690432.698859:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503624704 00000100:00100000:1.0:1779690432.698902:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 507 00000100:00100000:1.0:1779690432.698911:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+44:103218:x1866137503624704:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690432.699124:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.699140:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690432.699150:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690432.699214:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902118 00000004:00010000:1.0:1779690432.699253:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000799adf5e reply state 000000005aa36dcd transno 12884902119 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690432.699262:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690432.699337:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:103218:x1866137503624704:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 427us (660us total) trans 12884902119 rc 0/0 00000100:00100000:1.0:1779690432.699343:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 507 00000020:00080000:1.0:1779690432.699347:0:57585:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1779690432.701164:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690432.701356:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701367:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701374:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701381:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690432.701385:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701393:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701408:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:3.0:1779690432.701411:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690432.701437:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690432.701444:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e85f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690432.701459:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503624960 00000100:00100000:0.0:1779690432.701467:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503624960 00000100:00100000:0.0:1779690432.701508:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:0.0:1779690432.701517:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+46:103218:x1866137503624960:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690432.701690:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:103218:x1866137503624960:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 174us (529us total) trans 12884902120 rc 0/0 00000100:00100000:0.0:1779690432.701699:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:2.0:1779690432.725310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.725456:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625088 00000100:00100000:0.0:1779690432.725466:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625088 00000100:00100000:0.0:1779690432.725521:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 508 00000100:00100000:0.0:1779690432.725532:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+47:103220:x1866137503625088:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690432.725554:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.725573:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbc1 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725632:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725647:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725658:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725673:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725681:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725704:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725843:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e87b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725852:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725859:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.725890:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7c:0x0]: returning size 512 00000004:00200000:0.0:1779690432.725894:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.725916:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725930:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725936:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725943:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725948:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.725953:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725960:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725979:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690432.725982:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.725988:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.725994:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d400/0xb4bb873a1913e86d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726008:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726014:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726019:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726024:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.726027:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726032:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726040:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc4e44f (ffff9e308bf54200) 00010000:00010000:0.0:1779690432.726042:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.726045:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726050:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d800/0xb4bb873a1913e874 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726091:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483de00/0xb4bb873a1913e866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbc1 expref: 49 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726105:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ca00/0xb4bb873a1913e87b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbc1 expref: 48 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.726113:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:0.0:1779690432.726115:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690432.726118:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b483ca00, rc 0) 00000100:00100000:0.0:1779690432.726167:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+48:103220:x1866137503625088:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 636us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.726174:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 508 00000100:00100000:3.0:1779690432.732730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690432.732973:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625216 00000100:00100000:0.0:1779690432.732984:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625216 00000100:00100000:0.0:1779690432.733037:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 509 00000100:00100000:0.0:1779690432.733047:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:103220:x1866137503625216:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690432.733065:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690432.733084:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e882 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbc8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733149:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733163:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733174:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733206:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733215:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733221:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.733999:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734010:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734018:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690432.734052:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e:0x0]: returning size 1516 00000004:00200000:0.0:1779690432.734056:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690432.734072:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734082:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734090:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734097:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734114:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734120:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b483c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.734123:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734131:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734142:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:0.0:1779690432.734145:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.734149:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734156:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483c800/0xb4bb873a1913e889 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734170:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734176:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734181:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734186:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690432.734188:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734204:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734213:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0xee703f54 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690432.734216:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690432.734219:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734224:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913e890 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0xee703f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734259:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483ce00/0xb4bb873a1913e882 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbc8 expref: 50 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734273:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbc8 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690432.734281:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:0.0:1779690432.734283:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690432.734286:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f600, rc 0) 00000100:00100000:0.0:1779690432.734353:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+49:103220:x1866137503625216:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1307us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690432.734361:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 509 00010000:00010000:3.0:1779690432.969133:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690433.481356:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690433.481375:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492313344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690433.481473:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690433.481576:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313344 00000100:00100000:3.0:1779690433.481583:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313344 00000100:00100000:3.0:1779690433.481649:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1779690433.481659:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492313344:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690433.481665:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690433.481679:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492313472:0@lo:400:kworker.0 00002000:00000024:3.0:1779690433.481694:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690433.481719:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690433.481756:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492313344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690433.481766:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1779690433.481847:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313472 00000100:00100000:3.0:1779690433.481850:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313472 00000100:00100000:3.0:1779690433.481881:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1779690433.481888:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492313472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690433.481917:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492313472:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690433.481924:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1779690433.481933:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690433.481959:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492313600:0@lo:400:kworker.0 00000100:00100000:0.0:1779690433.481970:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492313856:0@lo:400:kworker.0 00000100:00100000:3.0:1779690433.481993:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690433.482011:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690433.482023:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492314112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690433.482051:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492313472:0@lo:400:kworker.0 00000100:00100000:3.0:1779690433.482057:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690433.482067:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690433.482087:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492313984:0@lo:400:kworker.0 00000100:00100000:3.0:1779690433.482088:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690433.482106:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492313728:0@lo:400:kworker.0 00000100:00100000:2.0:1779690433.482115:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313600 00000100:00100000:0.0:1779690433.482117:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690433.482121:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313600 00000100:00100000:3.0:1779690433.482140:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690433.482155:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313856 00000100:00100000:0.0:1779690433.482161:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313856 00000100:00100000:1.0:1779690433.482166:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492314112 00000100:00100000:2.0:1779690433.482176:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313984 00000100:00100000:1.0:1779690433.482178:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492314112 00000100:00100000:2.0:1779690433.482182:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313984 00000100:00100000:3.0:1779690433.482187:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492313728 00000100:00100000:3.0:1779690433.482192:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492313728 00000100:00100000:0.0:1779690433.482206:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1779690433.482218:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492313856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690433.482227:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1779690433.482228:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1779690433.482241:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1779690433.482245:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492314112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690433.482246:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492313600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690433.482257:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690433.482262:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492313856:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00002000:00000024:1.0:1779690433.482276:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 620167168 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690433.482298:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:3.0:1779690433.482306:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492313984:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690433.482313:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1779690433.482328:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1779690433.482329:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492313600:12345-0@lo:400:kworker.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690433.482339:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690433.482340:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1779690433.482358:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492313600:0@lo:400:kworker.0 00000100:00080000:2.0:1779690433.482369:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690433.482374:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690433.482379:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492314112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690433.482386:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492313728:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690433.482393:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1779690433.482423:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492313728:0@lo:400:kworker.0 00000100:00100000:0.0:1779690433.482467:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492313344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690433.482488:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492313984:0@lo:400:kworker.0 00000100:00100000:0.0:1779690433.482497:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492313856:0@lo:400:kworker.0 00000100:00100000:1.0:1779690433.484525:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492314112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2281us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690433.484538:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000040:00080000:2.0:1779690433.880632:0:65562:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690433.880641:0:65562:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690433.881269:0:65562:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690433.881277:0:65562:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690433.994853:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1779690434.568337:0:65611:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc99f6a160 00000004:00000080:2.0:1779690434.568354:0:65611:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e308595f400 uarg=0000000000000000 00000004:00000080:2.0:1779690434.568393:0:65611:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e308595f400 00000040:00080000:2.0:1779690434.568739:0:65611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].4, 80 off8512 00000004:00000080:2.0:1779690434.568765:0:65611:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl4', mask 0x0 00000004:02000000:2.0:1779690434.568769:0:65611:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690434.631165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690434.631225:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625344 00000100:00100000:3.0:1779690434.631235:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625344 00000100:00100000:3.0:1779690434.631306:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 510 00000100:00100000:3.0:1779690434.631315:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+49:103260:x1866137503625344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690434.631335:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690434.631354:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e89e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbcf expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631430:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631445:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631458:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690434.631524:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7c:0x0]: returning size 512 00000004:00200000:3.0:1779690434.631529:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690434.631551:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631574:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e89e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 51 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631587:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 50 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.631595:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:3.0:1779690434.631598:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690434.631601:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:3.0:1779690434.631652:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+50:103260:x1866137503625344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 338us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690434.631659:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 510 00000100:00080000:0.0:1779690434.631827:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690434.640623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690434.640681:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625600 00000100:00100000:3.0:1779690434.640689:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625600 00000100:00100000:3.0:1779690434.640744:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18658 00000100:00100000:3.0:1779690434.640753:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+50:103260:x1866137503625600:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:3.0:1779690434.640765:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1779690434.640787:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913e897 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbc8 expref: 50 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.640824:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e851 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbba expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690434.640845:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e2f903c9f00) 00010000:00010000:3.0:1779690434.640853:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690434.640903:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+48:103260:x1866137503625600:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690434.641000:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18658 00000100:00100000:3.0:1779690434.645280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690434.645381:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625728 00000100:00100000:0.0:1779690434.645390:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625728 00000100:00100000:0.0:1779690434.645453:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 511 00000100:00100000:0.0:1779690434.645463:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+48:103260:x1866137503625728:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:0.0:1779690434.645564:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690434.645580:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690434.645599:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690434.645925:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].24, 136 off11456 00000100:00100000:0.0:1779690434.646005:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+48:103260:x1866137503625728:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 543us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690434.646013:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 511 00010000:00010000:0.0:1779690435.018845:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690435.166702:0:65660:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690435.166711:0:65660:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690435.166787:0:65660:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 25 count 11 00000040:00080000:0.0:1779690435.166795:0:65660:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690435.530560:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690435.530569:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690435.538342:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 25 count 11 00000040:00080000:0.0:1779690435.538355:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690435.538489:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492314240:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690435.538584:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3086034c00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690435.545675:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492314240:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690435.547064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.548343:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625856 00000100:00100000:1.0:1779690435.548353:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625856 00000100:00100000:1.0:1779690435.548430:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 512 00000100:00100000:1.0:1779690435.548440:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503625856:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690435.548471:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x7e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690435.548577:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503625856:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 139us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.548586:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 512 00000100:00080000:3.0:1779690435.548694:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690435.558665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.559584:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503625984 00000100:00100000:1.0:1779690435.559594:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503625984 00000100:00100000:1.0:1779690435.559649:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 513 00000100:00100000:1.0:1779690435.559659:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503625984:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1779690435.559727:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559746:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559776:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559793:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559800:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559831:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559857:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559864:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559869:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690435.559901:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e:0x0]: returning size 1516 00000004:00200000:1.0:1779690435.559906:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690435.559917:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559928:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559934:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559951:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559956:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.559960:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559980:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.559992:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690435.559995:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690435.559999:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560005:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e8b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560020:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560026:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560031:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560036:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.560039:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560054:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560062:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xa40aa2cf (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690435.560065:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690435.560067:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560073:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e8ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa40aa2cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560087:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560093:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560098:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560120:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.560123:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560130:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560137:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:1.0:1779690435.560139:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690435.560142:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.560157:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e8c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.560231:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503625984:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 573us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.560239:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 513 00000100:00100000:0.0:1779690435.569408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690435.569742:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503626240 00000100:00100000:2.0:1779690435.569751:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503626240 00000100:00100000:2.0:1779690435.569827:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 514 00000100:00100000:2.0:1779690435.569837:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503626240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690435.569856:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690435.569883:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e8c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbd6 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.569989:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570004:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570016:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690435.570028:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e:0x0]: returning size 1516 00010000:00010000:2.0:1779690435.570162:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570170:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570177:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570183:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690435.570188:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570196:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570209:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:2.0:1779690435.570212:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690435.570218:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570230:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913e8cf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570270:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e8c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbd6 expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570282:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690435.570284:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690435.570289:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913e8c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbd6 expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690435.570298:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690435.570354:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503626240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 518us (966us total) trans 12884902121 rc 301/301 00000100:00100000:2.0:1779690435.570361:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 514 00000100:00100000:2.0:1779690435.575189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.575473:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503626368 00000100:00100000:1.0:1779690435.575482:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503626368 00000100:00100000:1.0:1779690435.575537:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 515 00000100:00100000:1.0:1779690435.575549:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503626368:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690435.575594:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x7e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690435.575702:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503626368:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 155us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.575709:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 515 00000100:00100000:0.0:1779690435.580069:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690435.580155:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503626496 00000100:00100000:3.0:1779690435.580164:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503626496 00000100:00100000:3.0:1779690435.580218:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 516 00000100:00100000:3.0:1779690435.580226:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503626496:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690435.580245:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690435.580262:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e8dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbdd expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580332:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580347:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580358:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580385:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580419:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580426:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580855:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e8f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580865:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.580873:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690435.580955:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7c:0x0]: returning size 7680 00000004:00200000:3.0:1779690435.580960:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690435.581034:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581046:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581051:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581057:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581063:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690435.581067:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581081:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581093:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690435.581096:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690435.581101:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581107:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913e8e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581118:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581124:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581130:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581135:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690435.581137:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581143:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581150:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc4e44f (ffff9e2f883cba00) 00010000:00010000:3.0:1779690435.581153:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690435.581155:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581171:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e8eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc4e44f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581202:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913e8dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbdd expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581216:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e000/0xb4bb873a1913e8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbdd expref: 41 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.581224:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:3.0:1779690435.581226:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690435.581229:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e000, rc 0) 00000100:00100000:3.0:1779690435.581289:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503626496:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1062us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690435.581296:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 516 00000001:00080000:3.0:1779690435.585672:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902120 is committed 00000001:00080000:3.0:1779690435.585690:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902112 is committed 00000100:00100000:1.0:1779690435.585948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.586047:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503626752 00000100:00100000:0.0:1779690435.586058:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503626752 00000100:00100000:0.0:1779690435.586114:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 517 00000100:00100000:0.0:1779690435.586124:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:103271:x1866137503626752:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.586143:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690435.586163:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e8f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbe4 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690435.586930:0:57559:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ea:0x0], index 1: 0 00010000:00010000:0.0:1779690435.587167:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913e900 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.587181:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913e900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.587193:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913e900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.587244:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e8f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbe4 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.587260:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913e900 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbe4 expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.587269:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690435.587272:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690435.587276:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e000, rc 0) 00000100:00100000:0.0:1779690435.587331:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503626752:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1209us (1387us total) trans 12884902122 rc 0/0 00000100:00100000:0.0:1779690435.587339:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 517 00000100:00100000:3.0:1779690435.592555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.592687:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627008 00000100:00100000:1.0:1779690435.592696:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627008 00000100:00100000:1.0:1779690435.592749:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 518 00000100:00100000:1.0:1779690435.592759:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503627008:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690435.592901:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690435.592930:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913e900 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbe4 expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.592949:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690435.592960:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690435.592994:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.593055:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 39 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.593064:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.593096:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 39 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.593111:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 39 pid: 64445 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.593124:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492314368:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690435.593238:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690435.597304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.597409:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492314368:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690435.597433:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627136 00010000:00010000:1.0:1779690435.597439:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690435.597441:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627136 00010000:00010000:3.0:1779690435.597477:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 40 pid: 64445 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690435.597523:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3226 00000100:00100000:3.0:1779690435.597532:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+40:2391:x1866137503627136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690435.597547:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690435.597565:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 40 pid: 64445 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597576:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 40 pid: 64445 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597596:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913e8a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbcf expref: 40 pid: 64445 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597611:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:3.0:1779690435.597616:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597625:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597632:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.597658:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690435.597711:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:2391:x1866137503627136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 179us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690435.597719:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3226 00010000:00010000:1.0:1779690435.597852:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.597860:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.597883:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.597907:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.597915:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598179:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598188:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598195:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598201:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.598205:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598212:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598221:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x0 (ffff9e308bf54600) 00010000:00010000:1.0:1779690435.598224:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690435.598228:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598234:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e90e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598245:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598258:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598264:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598268:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.598271:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598277:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598285:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7c:0x0].0x31846cef (ffff9e2f903c9b00) 00010000:00010000:1.0:1779690435.598287:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690435.598290:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.598295:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e915 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7c:0x0].0x31846cef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.598351:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503627008:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 5593us (5806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1779690435.598359:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 518 00000100:00100000:2.0:1779690435.600376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.600434:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627264 00000100:00100000:0.0:1779690435.600442:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627264 00000100:00100000:0.0:1779690435.600494:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 519 00000100:00100000:0.0:1779690435.600502:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503627264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.600521:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690435.600541:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e91c lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbeb expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600593:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600606:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600616:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600704:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e91c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600720:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.600728:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690435.600730:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690435.600734:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690435.600790:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503627264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 288us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.600796:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 519 00000100:00100000:2.0:1779690435.610506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.611667:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627520 00000100:00100000:0.0:1779690435.611677:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627520 00000100:00100000:0.0:1779690435.611737:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 520 00000100:00100000:0.0:1779690435.611747:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503627520:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.611842:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.611875:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.611887:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690435.612564:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].6, 88 off8624 00000004:00080000:0.0:1779690435.612575:0:57559:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3163186768886ns, next at 3164186766541ns, rc = 0 00000004:00010000:0.0:1779690435.612665:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000b641d32 reply state 0000000011ceeb85 transno 12884902123 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.612675:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690435.612777:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+43:103271:x1866137503627520:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1031us (2278us total) trans 12884902123 rc 0/0 00000100:00100000:0.0:1779690435.612784:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 520 00010000:00010000:3.0:1779690435.616405:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616430:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616438:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616463:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690435.616467:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616475:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616494:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:3.0:1779690435.616498:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690435.616502:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.616511:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913e92a lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690435.623750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.623915:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627648 00000100:00100000:1.0:1779690435.623924:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627648 00000100:00100000:1.0:1779690435.624223:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 521 00000100:00100000:1.0:1779690435.624233:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+42:103271:x1866137503627648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690435.624257:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690435.624294:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbf2 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.624356:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.624372:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.624402:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690435.624406:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690435.624409:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690435.624467:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+43:103271:x1866137503627648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 236us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.624473:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 521 00000100:00100000:2.0:1779690435.627047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.627270:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503627776 00000100:00100000:0.0:1779690435.627279:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503627776 00000100:00100000:0.0:1779690435.627352:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6398 00000100:00100000:0.0:1779690435.627362:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503627776:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1779690435.627759:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690435.627798:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503627776:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 437us (756us total) trans 4294968404 rc 0/0 00000100:00100000:0.0:1779690435.627872:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6398 00000100:00100000:2.0:1779690435.630467:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690435.630690:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628032 00000100:00100000:3.0:1779690435.630704:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628032 00000100:00100000:3.0:1779690435.630798:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:3.0:1779690435.630844:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+43:103271:x1866137503628032:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690435.631194:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+44:103271:x1866137503628032:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 387us (732us total) trans 12884902124 rc 0/0 00000100:00100000:3.0:1779690435.631202:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:2.0:1779690435.633027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.633227:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628288 00000100:00100000:1.0:1779690435.633235:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628288 00000100:00100000:1.0:1779690435.633283:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 522 00000100:00100000:1.0:1779690435.633291:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+44:103271:x1866137503628288:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690435.633379:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+44:103271:x1866137503628288:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.633386:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 522 00000100:00100000:2.0:1779690435.637193:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.637307:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628416 00000100:00100000:0.0:1779690435.637316:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628416 00000100:00100000:0.0:1779690435.637373:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 523 00000100:00100000:0.0:1779690435.637400:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+44:103271:x1866137503628416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.637418:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690435.637699:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913e938 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedbf9 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637777:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637792:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637837:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690435.637874:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690435.637893:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637921:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913e938 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf9 expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637938:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf9 expref: 45 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.637948:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690435.637951:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1779690435.637954:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fe00, rc 0) 00000100:00100000:0.0:1779690435.638016:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503628416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 635us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.638023:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 523 00000100:00100000:2.0:1779690435.642004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.642147:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628544 00000100:00100000:0.0:1779690435.642156:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628544 00000100:00100000:0.0:1779690435.642272:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6399 00000100:00100000:0.0:1779690435.642282:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503628544:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.642299:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690435.642318:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc00 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690435.642343:0:6582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a13ebc3, blocks: 0x1 00010000:00010000:0.0:1779690435.642362:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.642364:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.642372:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.642402:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.642414:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f000, rc 0) 00000100:00100000:0.0:1779690435.642467:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2389:x1866137503628544:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 187us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.642474:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6399 00000100:00100000:2.0:1779690435.646377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.646493:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628800 00000100:00100000:1.0:1779690435.646502:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628800 00000100:00100000:1.0:1779690435.646600:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 524 00000100:00100000:1.0:1779690435.646619:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503628800:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690435.646712:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503628800:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 103us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.646730:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 524 00000100:00100000:2.0:1779690435.649006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.649076:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503628928 00000100:00100000:0.0:1779690435.649089:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503628928 00000100:00100000:0.0:1779690435.649143:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6400 00000100:00100000:0.0:1779690435.649153:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+12:103271:x1866137503628928:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.649168:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690435.649185:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc07 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.649227:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.649236:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.649238:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.649243:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 13 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.649275:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.649302:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 3263 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.649316:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492314496:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690435.649423:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3086034c00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690435.653162:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492314496:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690435.653195:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 13 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.653215:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e400, rc 0) 00000100:00100000:1.0:1779690435.653270:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:103271:x1866137503628928:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 4119us (4270us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.653279:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6400 00000100:00100000:2.0:1779690435.657254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.657328:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629056 00000100:00100000:0.0:1779690435.657336:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629056 00010000:00010000:0.0:1779690435.657442:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 3263 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.657478:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3227 00000100:00100000:0.0:1779690435.657487:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503629056:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690435.657500:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690435.657679:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 3263 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.657691:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 3263 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.657708:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913e946 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc00 expref: 13 pid: 6582 timeout: 3263 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.657721:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.657723:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690435.657731:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.657740:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.657900:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.657915:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5780:1866137492314624:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690435.657995:0:5780:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3086034240 going to sleep for 11 seconds 00000100:00100000:0.0:1779690435.664999:0:5780:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5780:1866137492314624:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690435.665025:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690435.665075:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503629056:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 7589us (7829us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.665155:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3227 00000100:00100000:1.0:1779690435.669107:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690435.669345:0:37918:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629184 00000100:00100000:3.0:1779690435.669355:0:37918:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629184 00002000:00100000:3.0:1779690435.669410:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1ea:0x0] (0->1515) req@ffff9e30a8e56a00 x1866137503629184/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:671/0 lens 2008/0 e 0 to 0 dl 1779690446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690435.669420:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e56a00 with x1866137503629184 ext(0->1515) 00002000:00010000:3.0:1779690435.669438:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30a8e56a00 00000100:00100000:3.0:1779690435.669475:0:37918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2045 00000100:00100000:3.0:1779690435.669484:0:37918:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503629184:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690435.670946:0:37918:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503629184:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 1457us (1841us total) trans 4294968405 rc 0/0 00000100:00100000:3.0:1779690435.670957:0:37918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2045 00002000:00100000:3.0:1779690435.670965:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1ea:0x0] (0->1515) req@ffff9e30a8e56a00 x1866137503629184/t4294968405(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:671/0 lens 2008/448 e 0 to 0 dl 1779690446 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690435.670974:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e56a00 with x1866137503629184 ext(0->1515) 00002000:00010000:3.0:1779690435.670978:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30a8e56a00 00000100:00100000:2.0:1779690435.675631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690435.675729:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629312 00000100:00100000:3.0:1779690435.675748:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629312 00000100:00100000:3.0:1779690435.675842:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 525 00000100:00100000:3.0:1779690435.675853:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503629312:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1779690435.717563:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902123 is committed 00000004:00080000:2.0:1779690435.717575:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1779690435.717606:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902124 is committed 00000100:00100000:3.0:1779690435.717801:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690435.717851:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492314752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1779690435.717917:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690435.718128:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492314752 00000100:00100000:3.0:1779690435.718136:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492314752 00000100:00100000:3.0:1779690435.718199:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6401 00000100:00100000:3.0:1779690435.718207:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492314752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1779690435.718351:0:10273:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690435.718355:0:10273:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb mtime from disk: 0 -> 1779690435 00002000:00010000:3.0:1779690435.718357:0:10273:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1779690435.718359:0:10273:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb ctime from disk: 1779690435 -> 1779690435 00002000:00010000:3.0:1779690435.718374:0:10273:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1779690435.718423:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492314752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (504us total) trans 4294968406 rc 0/0 00000100:00100000:3.0:1779690435.718431:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6401 00000004:00080000:3.0:1779690435.718474:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f82fa0000/2, rc 0, transno 4294968406 00000100:00100000:3.0:1779690435.718480:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492314752:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1779690435.718569:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690435.718801:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503629312:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 42948us (43174us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.718831:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 525 00000100:00100000:2.0:1779690435.725526:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.725624:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629440 00000100:00100000:0.0:1779690435.725634:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629440 00000100:00100000:0.0:1779690435.725697:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6402 00000100:00100000:0.0:1779690435.725707:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+14:2389:x1866137503629440:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1779690435.780178:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968404 is committed 00000001:00080000:3.0:1779690435.780197:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968406 is committed 00000001:00080000:3.0:1779690435.780203:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968405 is committed 00000100:00100000:1.0:1779690435.780344:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503629440:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 54633us (54823us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.780356:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6402 00000100:00100000:2.0:1779690435.788162:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.788484:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629696 00000100:00100000:0.0:1779690435.788505:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629696 00000100:00100000:0.0:1779690435.788567:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 526 00000100:00100000:0.0:1779690435.789183:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503629696:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.789238:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690435.789267:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e93f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf9 expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.789286:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690435.789291:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690435.789318:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.789333:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.789342:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690435.790230:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d98b6c47 reply state 0000000042b70c21 transno 12884902125 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.790242:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690435.790344:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+42:103271:x1866137503629696:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1334us (2189us total) trans 12884902125 rc 0/0 00000100:00100000:1.0:1779690435.790352:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 526 00010000:00010000:3.0:1779690435.795359:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.795376:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.795383:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.795400:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690435.795405:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690435.795411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690435.795412:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.795429:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:3.0:1779690435.795432:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690435.795437:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.795444:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e954 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.795719:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503629824 00000100:00100000:1.0:1779690435.795729:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503629824 00000100:00100000:1.0:1779690435.795800:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6403 00000100:00100000:1.0:1779690435.795844:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503629824:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1779690435.796069:0:49882:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb size from disk: 1516 -> 1516 00002000:00010000:1.0:1779690435.796073:0:49882:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb mtime from disk: 1779690435 -> 1645827007 00002000:00010000:1.0:1779690435.796075:0:49882:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb atime from disk: 0 -> 1779687293 00002000:00010000:1.0:1779690435.796078:0:49882:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb ctime from disk: 1779690435 -> 1779690432 00002000:00010000:1.0:1779690435.796080:0:49882:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1ea:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1779690435.796128:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503629824:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 293us (720us total) trans 4294968407 rc 0/0 00000100:00100000:1.0:1779690435.796136:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6403 00000100:00100000:0.0:1779690435.799045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.799138:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630080 00000100:00100000:1.0:1779690435.799147:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630080 00000100:00100000:1.0:1779690435.799199:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 527 00000100:00100000:1.0:1779690435.799207:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103271:x1866137503630080:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1779690435.799271:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.799288:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.799297:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.799328:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.799341:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 41 pid: 57560 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.799373:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492314880:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690435.799475:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3083106000 going to sleep for 11 seconds 00000100:00100000:2.0:1779690435.802080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690435.802131:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630208 00000100:00100000:3.0:1779690435.802140:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630208 00010000:00010000:3.0:1779690435.802176:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 42 pid: 57560 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690435.802219:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3228 00000100:00100000:3.0:1779690435.802228:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+42:2391:x1866137503630208:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690435.802252:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690435.802259:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 42 pid: 57560 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.802271:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 42 pid: 57560 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.802292:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:3.0:1779690435.802298:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.802307:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.802314:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.802332:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690435.802385:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+42:2391:x1866137503630208:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 157us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690435.802403:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3228 00010000:00010000:1.0:1779690435.805960:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e923 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbeb expref: 41 pid: 57560 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.805984:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492314880:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690435.806007:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806016:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806021:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806050:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806057:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806064:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806069:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690435.806073:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806097:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806114:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690435.806118:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690435.806122:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.806128:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e95b lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.806202:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503630080:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 6995us (7164us total) trans 0 rc -22/-22 00000100:00100000:1.0:1779690435.806212:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 527 00000100:00100000:2.0:1779690435.812556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.812836:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630336 00000100:00100000:0.0:1779690435.812846:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630336 00000100:00100000:0.0:1779690435.812918:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6404 00000100:00100000:0.0:1779690435.812928:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2390:x1866137503630336:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.812971:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.812991:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.813000:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690435.813002:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690435.813006:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.813039:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.813120:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.813135:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492315008:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690435.813217:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690435.819867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.819960:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630464 00000100:00100000:1.0:1779690435.819969:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630464 00010000:00010000:1.0:1779690435.820006:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 13 pid: 22279 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690435.820060:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3229 00000100:00100000:1.0:1779690435.820070:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503630464:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690435.820087:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690435.820104:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 13 pid: 22279 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.820115:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 13 pid: 22279 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.820149:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690435.820151:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690435.820155:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.820162:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.820176:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690435.820222:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503630464:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 155us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690435.820226:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3229 00010000:00010000:0.0:1779690435.820501:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101e3d3c/0xb4bb873a1913e94d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc07 expref: 12 pid: 22279 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.820600:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492315008:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690435.820620:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820637:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820644:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820668:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820677:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820685:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820691:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fe00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690435.820696:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820771:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820786:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.820848:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091c85025/0xb4bb873a1913e962 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.820899:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503630336:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 7973us (8351us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.820907:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6404 00000100:00100000:2.0:1779690435.823696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.823823:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630720 00000100:00100000:0.0:1779690435.823832:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630720 00000100:00100000:0.0:1779690435.823991:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 528 00000100:00100000:0.0:1779690435.824002:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:103271:x1866137503630720:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1779690435.824083:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824101:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824112:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824597:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824609:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 41 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824618:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824660:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 41 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.824674:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 41 pid: 57561 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.824688:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492315136:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690435.824777:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690435.827784:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492315136:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690435.827830:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690435.828437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690435.828510:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503630848 00000100:00100000:0.0:1779690435.828517:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503630848 00010000:00010000:0.0:1779690435.828550:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 42 pid: 57561 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.828587:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3230 00000100:00100000:0.0:1779690435.828602:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+42:2391:x1866137503630848:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690435.828618:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690435.828624:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 42 pid: 57561 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828635:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 42 pid: 57561 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828677:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e931 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedbf2 expref: 42 pid: 57561 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828692:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690435.828697:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828705:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828713:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.828745:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690435.828798:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+41:2391:x1866137503630848:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 203us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690435.828836:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3230 00010000:00010000:1.0:1779690435.829022:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.829030:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690435.829357:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902126 00000001:00080000:1.0:1779690435.829869:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902127 00000001:00080000:1.0:1779690435.830006:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902128 00000100:00100000:1.0:1779690435.830091:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:57585:1866137492315264:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1779690435.830184:0:57585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690435.830211:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f950a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1779690435.830332:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315264 00000100:00100000:3.0:1779690435.830336:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315264 00000100:00100000:3.0:1779690435.830366:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:3.0:1779690435.830371:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57585:x1866137492315264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1779690435.830456:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57585:x1866137492315264:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690435.830463:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447 00000100:00100000:1.0:1779690435.831512:0:57585:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968406 gen 2 00000004:00080000:1.0:1779690435.831519:0:57585:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f82fa0000, transno 4294968406 00000100:00100000:1.0:1779690435.831534:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:57585:1866137492315264:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1779690435.832332:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902129 00000100:00100000:1.0:1779690435.832420:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:57585:1866137492315392:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1779690435.832465:0:57585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690435.832493:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f93439900 going to sleep for 11 seconds 00000100:00100000:3.0:1779690435.832579:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315392 00000100:00100000:3.0:1779690435.832586:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315392 00000100:00100000:3.0:1779690435.832637:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1779690435.832645:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57585:x1866137492315392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1779690435.832844:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57585:x1866137492315392:12345-0@lo:1000:mdt00_003.0 Request processed in 191us (370us total) trans 4294968408 rc 0/0 00000100:00100000:3.0:1779690435.832852:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448 00000100:00100000:0.0:1779690435.832986:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:57585:1866137492315392:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1779690435.833026:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833036:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833044:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833050:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690435.833061:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833069:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833083:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690435.833086:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690435.833091:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833096:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913e970 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690435.833264:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902130 00010000:00010000:0.0:1779690435.833291:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833297:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833303:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833311:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690435.833313:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833319:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833327:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690435.833329:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690435.833336:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833342:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913e8ac lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833359:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833370:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833377:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833383:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833397:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833403:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833407:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fe00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690435.833410:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833415:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833422:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690435.833424:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690435.833433:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833438:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913e977 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833447:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833456:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833462:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833467:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690435.833469:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833474:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833481:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e:0x0].0x0 (ffff9e308bf54e00) 00010000:00010000:0.0:1779690435.833483:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690435.833485:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690435.833552:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e969 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690435.833683:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503630720:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 9683us (9992us total) trans 12884902131 rc 0/0 00000100:00100000:0.0:1779690435.833691:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 528 00000020:00080000:0.0:1779690435.833699:0:57585:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1779690435.834531:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690435.834536:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690435.835786:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:3.0:1779690435.835951:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690435.836199:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690435.836736:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631104 00000100:00100000:1.0:1779690435.836745:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631104 00000100:00100000:1.0:1779690435.836797:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:1.0:1779690435.836943:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+45:103271:x1866137503631104:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1779690435.838237:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x18:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1779690435.838618:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902132 00010000:00010000:1.0:1779690435.838755:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838772:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838783:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838791:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838797:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838826:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690435.838854:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1779690435.839020:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690435.839026:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.839033:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690435.839037:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.839044:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.839066:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x18:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690435.839069:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690435.839073:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.839079:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913e97e lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690435.839095:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690435.839097:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690435.839098:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690435.839216:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+47:103271:x1866137503631104:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 2407us (3016us total) trans 12884902133 rc 0/0 00000100:00100000:1.0:1779690435.839234:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000020:00080000:1.0:1779690435.839240:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1779690436.038610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690436.038663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690436.038698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690436.038729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690436.038751:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690436.038936:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631744 00000100:00100000:3.0:1779690436.038946:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631744 00000100:00100000:0.0:1779690436.038999:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631232 00000100:00100000:0.0:1779690436.039004:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631232 00000100:00080000:2.0:1779690436.039015:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690436.039017:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631360 00000100:00100000:3.0:1779690436.039022:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631360 00000100:00100000:0.0:1779690436.039046:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:3.0:1779690436.039047:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2837 00000100:00100000:2.0:1779690436.039054:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631616 00000100:00100000:0.0:1779690436.039061:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503631232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690436.039062:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2389:x1866137503631744:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690436.039062:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631616 00000100:00100000:2.0:1779690436.039100:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2838 00000100:00100000:2.0:1779690436.039109:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503631360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690436.039127:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503631232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690436.039134:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:1.0:1779690436.039163:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2839 00000100:00100000:1.0:1779690436.039176:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503631616:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690436.039190:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631488 00000100:00100000:0.0:1779690436.039194:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631488 00000100:00100000:0.0:1779690436.039220:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:0.0:1779690436.039226:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+39:2389:x1866137503631488:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690436.041103:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+15:2389:x1866137503631744:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2039us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690436.041114:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2837 00000100:00080000:3.0:1779690436.041175:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690436.041181:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690436.042655:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503631360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3540us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690436.042667:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2838 00010000:00010000:2.0:1779690436.042739:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690436.043649:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+39:2389:x1866137503631488:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4418us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690436.044073:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503631616:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4900us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690436.044083:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2839 00000100:00100000:0.0:1779690436.044217:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00000040:00080000:3.0:1779690436.730266:0:65715:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690436.730274:0:65715:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690436.730341:0:65715:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 25 count 11 00000040:00080000:3.0:1779690436.730347:0:65715:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690436.804994:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690436.805071:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503631872 00000100:00100000:1.0:1779690436.805081:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503631872 00000100:00100000:1.0:1779690436.805146:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 529 00000100:00100000:1.0:1779690436.805157:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503631872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690436.805428:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503631872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 272us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690436.805438:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 529 00000100:00100000:3.0:1779690436.811904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690436.812009:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632000 00000100:00100000:0.0:1779690436.812017:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632000 00000100:00100000:0.0:1779690436.812065:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 530 00000100:00100000:0.0:1779690436.812075:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690436.812256:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690436.812327:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 253us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690436.812336:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 530 00000100:00100000:3.0:1779690436.816415:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690436.819022:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632128 00000100:00100000:0.0:1779690436.819033:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632128 00000100:00100000:0.0:1779690436.819097:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 531 00000100:00100000:0.0:1779690436.819109:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690436.819280:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690436.819363:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 256us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690436.819372:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 531 00000100:00100000:1.0:1779690436.822755:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690436.823003:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632256 00000100:00100000:2.0:1779690436.823012:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632256 00000100:00100000:2.0:1779690436.823122:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 532 00000100:00100000:2.0:1779690436.823133:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690436.823284:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690436.823371:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 240us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690436.823391:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 532 00000100:00100000:1.0:1779690436.825654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690436.825750:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632384 00000100:00100000:3.0:1779690436.825796:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632384 00000100:00100000:3.0:1779690436.825872:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 533 00000100:00100000:3.0:1779690436.825881:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632384:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690436.825978:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632384:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690436.825987:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 533 00000100:00100000:3.0:1779690436.827369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690436.828522:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632512 00000100:00100000:0.0:1779690436.828531:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632512 00000100:00100000:0.0:1779690436.828582:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 534 00000100:00100000:0.0:1779690436.828591:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632512:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690436.828742:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632512:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 151us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690436.828751:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 534 00000100:00100000:1.0:1779690436.831606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690436.831720:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632640 00000100:00100000:3.0:1779690436.831728:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632640 00000100:00100000:3.0:1779690436.831775:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 535 00000100:00100000:3.0:1779690436.831784:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632640:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690436.832024:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632640:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 240us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690436.832033:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 535 00000100:00100000:1.0:1779690436.836737:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690436.836899:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632768 00000100:00100000:3.0:1779690436.836909:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632768 00000100:00100000:3.0:1779690436.836969:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 536 00000100:00100000:3.0:1779690436.836978:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690436.837139:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103284:x1866137503632768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 162us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690436.837147:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 536 00010000:00010000:0.0:1779690437.065239:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690438.088996:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690438.601082:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492315904:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.601146:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690438.601163:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492315776:0@lo:400:kworker.0 00000100:00100000:0.0:1779690438.601200:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690438.601225:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492316288:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.601239:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315904 00000100:00100000:1.0:1779690438.601247:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315904 00000100:00100000:0.0:1779690438.601251:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690438.601286:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315776 00000100:00100000:0.0:1779690438.601291:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315776 00000100:00100000:1.0:1779690438.601301:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492316288 00000100:00100000:1.0:1779690438.601305:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492316288 00000100:00100000:0.0:1779690438.601335:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1779690438.601345:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601389:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492315520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690438.601413:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492315904:12345-0@lo:400:kworker.0 Request processed in 69us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690438.601427:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690438.601454:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492316032:0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601475:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690438.601509:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1779690438.601515:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492315648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601548:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690438.601570:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492316160:0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601593:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690438.601620:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492316032 00000100:00100000:2.0:1779690438.601624:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492316032 00000100:00100000:2.0:1779690438.601767:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492316160 00000100:00100000:2.0:1779690438.601770:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492316160 00000100:00100000:2.0:1779690438.601791:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1779690438.601798:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492316032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601913:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492316032:12345-0@lo:400:kworker.0 Request processed in 115us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690438.601935:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1779690438.601951:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1779690438.601957:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492316160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.601983:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492316160:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690438.601989:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1779690438.602025:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492316160:0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.602034:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492316032:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.602176:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1779690438.602195:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492315776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690438.602268:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492315776:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.602334:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492315776:12345-0@lo:400:kworker.0 Request processed in 144us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690438.602341:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1779690438.602354:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1779690438.602371:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492316288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.602408:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492316288:12345-0@lo:400:kworker.0 Request processed in 48us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690438.602415:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1779690438.602442:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492315904:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.602609:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315520 00000100:00100000:1.0:1779690438.602617:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315520 00000100:00100000:1.0:1779690438.602642:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1779690438.602648:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492315520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690438.602674:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690438.602714:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492315520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690438.602720:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00080000:1.0:1779690438.602739:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690438.602743:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690438.602745:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690438.602765:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492315520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690438.602894:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492315648 00000100:00100000:1.0:1779690438.602898:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492315648 00000100:00100000:1.0:1779690438.602922:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1779690438.602929:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492315648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.602970:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492315648:12345-0@lo:400:kworker.0 Request processed in 42us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690438.602977:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1779690438.603007:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492316416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690438.603027:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690438.603051:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492316416 00000100:00100000:1.0:1779690438.603054:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492316416 00000100:00100000:1.0:1779690438.603073:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1779690438.603079:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492316416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690438.603095:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690438.603124:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492316416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690438.603130:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1779690438.603154:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492316416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690438.603467:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492316288:0@lo:400:kworker.0 00000100:00100000:1.0:1779690438.603523:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492315648:0@lo:400:kworker.0 00000100:00100000:0.0:1779690438.603576:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:2.0:1779690439.112989:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690440.139418:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690440.666434:0:65911:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690440.666440:0:65911:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690440.666476:0:65911:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 5 count 2 00000040:00080000:3.0:1779690440.666487:0:65911:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690440.713307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690440.713701:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503632896 00000100:00100000:1.0:1779690440.713710:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503632896 00000100:00080000:3.0:1779690440.713766:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690440.713787:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 537 00000100:00100000:1.0:1779690440.713798:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:103723:x1866137503632896:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:1.0:1779690440.713858:0:57585:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b399c820 uarg=0000000000000000 00000004:00000080:1.0:1779690440.713897:0:57585:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b399c820 00000004:00000080:1.0:1779690440.713903:0:57585:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=4, endrec=0 00000040:00080000:1.0:1779690440.713994:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690440.713999:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690440.714046:0:57585:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl4 endrec = 11 00000040:00080000:1.0:1779690440.714143:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 5 count 2 00000040:00080000:1.0:1779690440.714152:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690440.714157:0:57585:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl4 entries up to 18446744073709551615 00000040:00080000:1.0:1779690440.714200:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690440.714203:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690440.714605:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 11 count 1 00000040:00080000:1.0:1779690440.714613:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1779690440.714699:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:103723:x1866137503632896:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 902us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690440.714708:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 537 00000100:00100000:1.0:1779690441.154151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690441.154187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690441.154221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690441.154250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690441.154269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690441.154290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690441.154413:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633152 00000100:00100000:0.0:1779690441.154432:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633152 00000100:00100000:0.0:1779690441.154481:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633536 00000100:00100000:0.0:1779690441.154484:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633536 00000100:00100000:0.0:1779690441.154509:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:0.0:1779690441.154517:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503633152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154577:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503633152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154584:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:0.0:1779690441.154601:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 160 00000100:00100000:0.0:1779690441.154607:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:2391:x1866137503633536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154629:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:2391:x1866137503633536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154636:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 160 00000100:00100000:0.0:1779690441.154654:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633024 00000100:00100000:0.0:1779690441.154657:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633024 00000100:00100000:0.0:1779690441.154678:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:0.0:1779690441.154683:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503633024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154703:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503633024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154709:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00080000:0.0:1779690441.154734:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690441.154767:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633408 00000100:00100000:0.0:1779690441.154770:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633408 00000100:00100000:0.0:1779690441.154823:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633664 00000100:00100000:0.0:1779690441.154826:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633664 00000100:00100000:0.0:1779690441.154841:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633280 00000100:00100000:0.0:1779690441.154843:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633280 00000100:00100000:0.0:1779690441.154865:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2842 00000100:00100000:0.0:1779690441.154871:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503633408:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154896:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503633408:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154902:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2842 00000100:00100000:0.0:1779690441.154910:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2843 00000100:00100000:0.0:1779690441.154915:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503633664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154930:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503633664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 15us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154935:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2843 00000100:00100000:0.0:1779690441.154943:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2844 00000100:00100000:0.0:1779690441.154948:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503633280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690441.154962:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503633280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 15us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690441.154968:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2844 00000100:00080000:0.0:1779690441.154978:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690441.154980:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690441.155156:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690441.155215:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633792 00000100:00100000:2.0:1779690441.155219:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633792 00000100:00100000:2.0:1779690441.155259:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2845 00000100:00100000:2.0:1779690441.155265:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503633792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690441.155294:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+15:2391:x1866137503633792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690441.155300:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2845 00000100:00080000:1.0:1779690441.155412:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690441.161489:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690441.198903:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902131 is committed 00000001:00080000:2.0:1779690441.198928:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902133 is committed 00000020:00080000:2.0:1779690441.198944:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f950a93c0 refcount 2 committed 0 result 0 batchid 8590018964 00000020:00080000:2.0:1779690441.198949:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e30870a3480 00000020:00080000:2.0:1779690441.198953:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f96b02400 00000020:00080000:1.0:1779690441.199209:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018964 committed batchid 8590018963 00000020:00080000:1.0:1779690441.200195:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018963 00000001:00080000:2.0:1779690441.201603:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968407 is committed 00000001:00080000:2.0:1779690441.201617:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968408 is committed 00000020:00000080:1.0:1779690441.331756:0:65962:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffd9e2be1f0 00000004:00000080:1.0:1779690441.331771:0:65962:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e30b4019800 uarg=0000000000000000 00000004:00000080:1.0:1779690441.331851:0:65962:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e30b4019800 00000004:00000080:1.0:1779690441.331859:0:65962:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=4, endrec=0 00000040:00080000:1.0:1779690441.331958:0:65962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.331963:0:65962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690441.331997:0:65962:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl4 endrec = 11 00000040:00080000:1.0:1779690441.332105:0:65962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 5 count 2 00000040:00080000:1.0:1779690441.332114:0:65962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690441.332143:0:65962:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl4 entries up to 18446744073709551615 00000040:00080000:1.0:1779690441.332188:0:65962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.332191:0:65962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690441.332742:0:65962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690441.332749:0:65962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:1.0:1779690441.332769:0:65962:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=4 00000040:00080000:1.0:1779690441.332838:0:65962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.332841:0:65962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690441.333055:0:65962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 4 count 1 00000040:00080000:1.0:1779690441.333060:0:65962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690441.333079:0:65962:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1779690441.333081:0:65962:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1779690441.340737:0:65962:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl4 record=18446744073709551615 00000040:00080000:1.0:1779690441.340885:0:65962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.340889:0:65962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690441.341523:0:65962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690441.341532:0:65962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:1.0:1779690441.341610:0:65962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.341613:0:65962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690441.342293:0:65962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690441.342299:0:65962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:1.0:1779690441.924175:0:66010:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690441.924183:0:66010:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690441.925513:0:66010:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690441.925529:0:66010:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690442.108578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690442.111698:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503633920 00000100:00100000:1.0:1779690442.111712:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503633920 00000100:00080000:0.0:1779690442.111867:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690442.112362:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 538 00000100:00100000:1.0:1779690442.112387:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:103174:x1866137503633920:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1779690442.112495:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+38:103174:x1866137503633920:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 110us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690442.112508:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 538 00000100:00100000:0.0:1779690442.115038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690442.115139:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503634176 00000100:00100000:3.0:1779690442.115148:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503634176 00000100:00100000:3.0:1779690442.115189:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:3.0:1779690442.115199:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90559450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+38:103174:x1866137503634176:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690442.115675:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90559450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+39:103174:x1866137503634176:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 476us (642us total) trans 12884902134 rc 0/0 00000100:00100000:3.0:1779690442.115682:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00010000:00010000:2.0:1779690442.184986:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690443.018436:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690443.018444:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690443.018801:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 25 count 9 00000040:00080000:0.0:1779690443.018839:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690443.221931:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690443.324188:0:66058:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222b: Changelog for implicit restore == 02:27:22 (1779690442) 00000100:00100000:2.0:1779690443.583533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.583956:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503634432 00000100:00100000:0.0:1779690443.583967:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503634432 00000100:00100000:0.0:1779690443.584034:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 539 00000100:00100000:0.0:1779690443.584057:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:103936:x1866137503634432:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690443.584081:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690443.584101:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e985 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc0e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584171:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584186:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584198:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584212:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584220:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584227:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584649:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e99a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584658:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584664:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690443.584684:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690443.584849:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584857:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584863:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584869:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690443.584873:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584881:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584892:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690443.584895:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.584905:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584911:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913e98c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584922:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584928:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584943:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584948:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690443.584951:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584957:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584965:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690443.584967:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.584970:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.584975:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e993 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.585293:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e985 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc0e expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.585316:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e99a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc0e expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.585323:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690443.585325:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.585328:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690443.585452:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103936:x1866137503634432:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1397us (1927us total) trans 12884902135 rc 0/0 00000100:00100000:0.0:1779690443.585469:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 539 00000100:00100000:1.0:1779690443.590909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690443.590981:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.591087:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503634560 00000100:00100000:0.0:1779690443.591095:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503634560 00000100:00100000:2.0:1779690443.591708:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503634688 00000100:00100000:2.0:1779690443.591713:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503634688 00000100:00100000:2.0:1779690443.591755:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 540 00000100:00100000:2.0:1779690443.591765:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+42:103936:x1866137503634688:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690443.591799:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18659 00000100:00100000:2.0:1779690443.591888:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+42:103936:x1866137503634688:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 124us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690443.591896:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 540 00000100:00100000:0.0:1779690443.592009:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+41:2391:x1866137503634560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690443.592020:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690443.592044:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e99a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc0e expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.592061:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690443.592067:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690443.592088:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+40:2391:x1866137503634560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 83us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690443.592119:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18659 00000100:00100000:2.0:1779690443.605515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690443.605611:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503634816 00000100:00100000:1.0:1779690443.605620:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503634816 00000100:00100000:1.0:1779690443.605694:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 541 00000100:00100000:1.0:1779690443.605704:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+39:103937:x1866137503634816:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690443.605722:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690443.605739:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e9a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc15 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605830:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605843:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605850:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605861:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605865:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.605881:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606305:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606322:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606328:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606333:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690443.606338:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606345:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606357:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:1.0:1779690443.606360:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.606364:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606370:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606382:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606388:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606400:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606406:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690443.606408:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606414:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606423:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa119335 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690443.606425:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.606428:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606434:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606462:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e9a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc15 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606472:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:1.0:1779690443.606475:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.606478:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e9a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc15 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.606487:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00080000:0.0:1779690443.606612:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690443.606649:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+39:103937:x1866137503634816:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 946us (1141us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690443.606665:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 541 00000100:00100000:2.0:1779690443.611198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.611429:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635072 00000100:00100000:0.0:1779690443.611438:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635072 00000100:00100000:0.0:1779690443.611528:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 542 00000100:00100000:0.0:1779690443.611538:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+39:103937:x1866137503635072:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690443.611592:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690443.611627:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483d000/0xb4bb873a1913e7e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb97 expref: 39 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.611646:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690443.611651:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690443.611980:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.611999:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.612008:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.612038:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 39 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.612050:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 39 pid: 57561 timeout: 3271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.612064:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492316544:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690443.612138:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1779690443.614604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690443.614675:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635200 00000100:00100000:1.0:1779690443.614683:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635200 00010000:00010000:1.0:1779690443.614719:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 40 pid: 57561 timeout: 3271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690443.614755:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3231 00000100:00100000:1.0:1779690443.614764:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+40:2392:x1866137503635200:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690443.614776:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690443.614783:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 40 pid: 57561 timeout: 3271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.614795:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 40 pid: 57561 timeout: 3271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.614861:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:1.0:1779690443.614867:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.614876:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.614883:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.614903:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690443.614957:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+40:2392:x1866137503635200:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 194us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690443.614978:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3231 00010000:00010000:0.0:1779690443.615136:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b483da00/0xb4bb873a1913e812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedba5 expref: 39 pid: 57561 timeout: 3271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.615152:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492316544:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690443.615170:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.615178:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.615183:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.615203:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.615220:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.615228:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690443.616318:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f:0x0]: returning size 512 00010000:00010000:0.0:1779690443.616329:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616337:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616345:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616351:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690443.616354:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616362:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616372:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690443.616375:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.616379:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.616384:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690443.616411:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000043422b3d reply state 00000000aeeca4a0 transno 12884902136 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.616419:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690443.616489:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+40:103937:x1866137503635072:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 4951us (5297us total) trans 12884902136 rc 0/0 00000100:00100000:0.0:1779690443.616497:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 542 00010000:00010000:1.0:1779690443.618184:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618196:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618203:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618209:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690443.618212:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618219:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618231:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa119335 (ffff9e2f8be8c300) 00010000:00010000:1.0:1779690443.618234:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.618238:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.618245:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913e9c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690443.622316:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690443.622438:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635328 00000100:00100000:3.0:1779690443.622448:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635328 00000100:00100000:3.0:1779690443.622549:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 543 00000100:00100000:3.0:1779690443.622559:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+39:103938:x1866137503635328:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1779690443.622582:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690443.622611:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e9cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc1c expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622672:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622685:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622695:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690443.622773:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690443.622777:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 104 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690443.622801:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622853:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913e9cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc1c expref: 41 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622868:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc1c expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.622876:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:3.0:1779690443.622879:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690443.622882:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53ee00, rc 0) 00000100:00100000:3.0:1779690443.622943:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+40:103938:x1866137503635328:12345-192.168.203.5@tcp:101:bash.0 Request processed in 385us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690443.622950:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 543 00000100:00100000:3.0:1779690443.624797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690443.625780:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635456 00000100:00100000:1.0:1779690443.625789:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635456 00000100:00100000:1.0:1779690443.625911:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 544 00000100:00100000:1.0:1779690443.625922:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+40:103938:x1866137503635456:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690443.625953:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690443.625971:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e9d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc23 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626031:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626045:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626054:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626068:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626075:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626081:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626181:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e9ee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626189:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e9ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626196:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e9ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690443.626225:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f:0x0]: returning size 512 00000004:00200000:1.0:1779690443.626234:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690443.626259:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e9ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626271:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626277:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626283:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626288:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690443.626292:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626300:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626321:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:1.0:1779690443.626325:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.626329:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626336:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913e9e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626347:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626353:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626369:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626375:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690443.626378:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626384:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626392:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa119335 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690443.626394:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690443.626398:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626402:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913e9e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626430:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913e9d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc23 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626442:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9600/0xb4bb873a1913e9ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc23 expref: 41 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690443.626449:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:1.0:1779690443.626451:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690443.626454:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9600, rc 0) 00000100:00100000:1.0:1779690443.626526:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+41:103938:x1866137503635456:12345-192.168.203.5@tcp:101:bash.0 Request processed in 606us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690443.626549:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 544 00000100:00100000:2.0:1779690443.630678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.630873:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635584 00000100:00100000:0.0:1779690443.630883:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635584 00000100:00100000:0.0:1779690443.630983:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 545 00000100:00100000:0.0:1779690443.630993:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+41:103938:x1866137503635584:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1779690443.631011:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690443.631029:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc2a expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631087:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631101:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631112:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631169:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631178:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631201:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631268:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631275:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631282:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631287:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690443.631292:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631299:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631319:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:0.0:1779690443.631323:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.631328:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631334:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913e9fc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631345:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631352:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631364:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631370:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690443.631373:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631380:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631387:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690443.631390:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.631392:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631397:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ea03 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631428:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9f5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc2a expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631438:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:0.0:1779690443.631440:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690443.631443:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913e9f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc2a expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.631452:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690443.631516:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+41:103938:x1866137503635584:12345-192.168.203.5@tcp:101:bash.0 Request processed in 525us (846us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690443.631533:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 545 00000100:00100000:2.0:1779690443.640741:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690443.641404:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635712 00000100:00100000:3.0:1779690443.641425:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635712 00000100:00100000:3.0:1779690443.641480:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 546 00000100:00100000:3.0:1779690443.641490:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:103939:x1866137503635712:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690443.641509:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690443.641527:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc31 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641600:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641624:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641635:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690443.641692:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690443.641697:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 104 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690443.641718:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641740:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 41 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641757:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.641765:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:3.0:1779690443.641768:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690443.641771:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c4000, rc 0) 00000100:00100000:3.0:1779690443.641884:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:103939:x1866137503635712:12345-192.168.203.5@tcp:101:rm.0 Request processed in 396us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690443.641891:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 546 00000100:00100000:1.0:1779690443.644171:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690443.644223:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635840 00000100:00100000:2.0:1779690443.644231:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635840 00000100:00100000:2.0:1779690443.644288:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 547 00000100:00100000:2.0:1779690443.644299:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:103939:x1866137503635840:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690443.644323:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690443.644339:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913ea18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc38 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644390:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644407:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644454:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644470:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644477:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644481:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644576:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913ea2d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644586:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644593:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690443.644621:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f:0x0]: returning size 512 00000004:00200000:2.0:1779690443.644625:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690443.644644:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644654:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644660:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644675:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644680:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.644684:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644691:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644700:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:2.0:1779690443.644703:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.644707:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644712:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ea1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644723:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644729:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644733:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644737:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.644740:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644753:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644760:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa119335 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690443.644762:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.644765:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644770:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913ea26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644960:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913ea18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc38 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644972:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f800/0xb4bb873a1913ea2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc38 expref: 41 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.644978:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.644981:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690443.644983:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f800, rc 0) 00000100:00100000:2.0:1779690443.645035:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103939:x1866137503635840:12345-192.168.203.5@tcp:101:rm.0 Request processed in 738us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690443.645043:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 547 00000100:00100000:0.0:1779690443.646999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690443.647074:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503635968 00000100:00100000:2.0:1779690443.647082:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503635968 00000100:00100000:2.0:1779690443.647128:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 548 00000100:00100000:2.0:1779690443.647137:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103939:x1866137503635968:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690443.647165:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690443.647182:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913ea34 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc3f expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647232:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647244:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647265:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647288:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647296:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647301:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647363:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647370:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647376:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647381:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.647389:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647396:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647406:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.647408:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.647422:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647428:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ea3b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647439:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647445:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647451:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647456:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.647459:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647464:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647471:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f826ec400) 00010000:00010000:2.0:1779690443.647473:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.647482:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647487:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ea42 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647514:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913ea34 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc3f expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647524:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.647526:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.647529:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913ea34 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc3f expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.647537:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690443.647579:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103939:x1866137503635968:12345-192.168.203.5@tcp:101:rm.0 Request processed in 443us (586us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690443.647585:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 548 00000100:00100000:1.0:1779690443.651650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690443.651719:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636096 00000100:00100000:2.0:1779690443.651728:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636096 00000100:00100000:2.0:1779690443.651785:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 549 00000100:00100000:2.0:1779690443.651795:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:103939:x1866137503636096:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690443.651837:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690443.651855:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea49 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc46 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651910:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651941:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651953:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651968:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651976:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.651982:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652039:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652046:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652053:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652059:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.652063:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652071:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652083:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.652091:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.652096:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652102:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea50 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652115:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652121:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652127:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652132:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.652135:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652141:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652148:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f826ec300) 00010000:00010000:2.0:1779690443.652151:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.652154:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652160:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea57 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652188:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea49 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc46 expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652203:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.652206:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.652210:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea49 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc46 expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.652219:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c800, rc 0) 00000100:00100000:2.0:1779690443.652263:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:103939:x1866137503636096:12345-192.168.203.5@tcp:101:rm.0 Request processed in 470us (621us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690443.652272:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 549 00000100:00100000:1.0:1779690443.665137:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690443.665228:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636224 00000100:00100000:2.0:1779690443.665237:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636224 00000100:00100000:2.0:1779690443.665295:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 550 00000100:00100000:2.0:1779690443.665304:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103940:x1866137503636224:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690443.665331:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690443.665349:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea5e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc4d expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665404:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665427:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665438:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665453:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665470:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665477:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665532:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665539:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665545:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665551:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.665555:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665563:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665573:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.665576:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.665580:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665586:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ea65 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665608:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665620:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665626:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665630:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690443.665633:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665639:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665647:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f826ec300) 00010000:00010000:2.0:1779690443.665649:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.665652:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665657:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ea6c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665685:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea5e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc4d expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665693:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690443.665695:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690443.665699:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ea5e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc4d expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690443.665718:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c800, rc 0) 00000100:00100000:2.0:1779690443.665770:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103940:x1866137503636224:12345-192.168.203.5@tcp:101:cp.0 Request processed in 467us (641us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690443.665778:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 550 00000100:00100000:0.0:1779690443.671786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690443.672000:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636352 00000100:00100000:3.0:1779690443.672011:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636352 00000100:00100000:3.0:1779690443.672098:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 551 00000100:00100000:3.0:1779690443.672109:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:103940:x1866137503636352:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690443.672129:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690443.672161:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea73 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc54 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672223:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672237:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672248:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672264:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672271:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672277:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672355:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672363:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672370:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672376:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690443.672380:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672397:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672410:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:3.0:1779690443.672424:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690443.672429:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672436:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea7a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672457:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672463:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672469:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672475:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690443.672477:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672483:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672490:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f883cba00) 00010000:00010000:3.0:1779690443.672493:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690443.672496:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672507:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea81 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672539:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea73 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc54 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672549:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:3.0:1779690443.672551:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690443.672554:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea73 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc54 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.672563:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5600, rc 0) 00000100:00100000:3.0:1779690443.672610:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:103940:x1866137503636352:12345-192.168.203.5@tcp:101:cp.0 Request processed in 504us (833us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690443.672618:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 551 00000100:00100000:1.0:1779690443.679966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690443.681593:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636608 00000100:00100000:3.0:1779690443.681605:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636608 00000100:00100000:3.0:1779690443.681677:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 552 00000100:00100000:3.0:1779690443.681687:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103940:x1866137503636608:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690443.681715:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690443.681735:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea88 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc5b expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681875:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681890:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681922:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681944:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681950:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.681957:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690443.683744:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1eb:0x0], index 0: 0 00010000:00010000:3.0:1779690443.683999:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684013:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684023:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684059:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684066:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684133:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684138:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690443.684150:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684259:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684274:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:3.0:1779690443.684277:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690443.684282:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684288:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913ea8f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690443.684301:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f17ffa17 reply state 00000000c1c6228b transno 12884902137 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690443.684322:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690443.684358:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ea88 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684372:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.684384:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690443.684387:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690443.684389:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:3.0:1779690443.684652:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+44:103940:x1866137503636608:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2965us (4693us total) trans 12884902137 rc 0/0 00000100:00100000:3.0:1779690443.684661:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 552 00010000:00010000:3.0:1779690443.689098:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689114:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689123:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689129:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690443.689134:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689141:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689156:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f883cba00) 00010000:00010000:3.0:1779690443.689159:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690443.689164:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.689170:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913ea96 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690443.690026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690443.691577:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636736 00000100:00100000:3.0:1779690443.691589:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636736 00000100:00100000:3.0:1779690443.691758:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6405 00000100:00100000:3.0:1779690443.691768:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503636736:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690443.691785:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690443.691818:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc62 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690443.691860:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690443.691878:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690443.691879:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690443.691887:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.691905:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.691917:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:3.0:1779690443.691972:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503636736:12345-192.168.203.5@tcp:101:cp.0 Request processed in 206us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690443.691979:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6405 00000100:00080000:0.0:1779690443.692085:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690443.697083:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.697733:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636864 00000100:00100000:0.0:1779690443.697742:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636864 00000100:00100000:0.0:1779690443.697795:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6406 00000100:00100000:0.0:1779690443.697836:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:103940:x1866137503636864:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690443.697853:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690443.697869:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc69 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.697899:0:49882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.697907:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690443.697909:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690443.697913:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 9 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.697945:0:49882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.697959:0:49882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 3271 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.697992:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492316672:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690443.698082:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1779690443.700470:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492316672:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690443.700502:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 9 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690443.700521:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ee00, rc 0) 00000100:00100000:2.0:1779690443.701290:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:103940:x1866137503636864:12345-192.168.203.5@tcp:101:cp.0 Request processed in 3485us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690443.701301:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6406 00000100:00100000:2.0:1779690443.705452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690443.705595:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503636992 00000100:00100000:0.0:1779690443.705604:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503636992 00010000:00010000:0.0:1779690443.705641:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 3271 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.705682:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3232 00000100:00100000:0.0:1779690443.705691:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503636992:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690443.705705:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690443.705727:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 3271 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.705740:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 3271 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.705775:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eaab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc62 expref: 9 pid: 22747 timeout: 3271 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.705792:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690443.705794:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690443.705801:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.705872:0:17231:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690443.705907:0:17231:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690443.705921:0:17231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17231:1866137492316800:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690443.705999:0:17231:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c540 going to sleep for 11 seconds 00000100:00100000:0.0:1779690443.710105:0:17231:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17231:1866137492316800:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690443.710131:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690443.710188:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503636992:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 4496us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690443.710198:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3232 00000100:00100000:3.0:1779690443.711109:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690443.711477:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503637248 00000100:00100000:1.0:1779690443.711486:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503637248 00000100:00100000:1.0:1779690443.711569:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1779690443.711579:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+43:103940:x1866137503637248:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:1.0:1779690443.711928:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+44:103940:x1866137503637248:12345-192.168.203.5@tcp:35:cp.0 Request processed in 350us (821us total) trans 12884902138 rc 0/0 00000100:00100000:1.0:1779690443.711935:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1779690443.721503:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492316928:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721571:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721623:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492317440:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721648:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721673:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1779690443.721679:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492317056:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721702:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721716:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492317568:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721744:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721780:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492317184:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721839:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721859:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690443.721864:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492317312:0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.721889:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.721917:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492316928 00000100:00100000:1.0:1779690443.721924:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492316928 00000100:00100000:1.0:1779690443.721966:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1779690443.721974:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.722111:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317056 00000100:00100000:0.0:1779690443.722116:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317056 00000100:00080000:0.0:1779690443.722135:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690443.722159:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317568 00000100:00100000:0.0:1779690443.722161:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317568 00000100:00100000:0.0:1779690443.722172:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317184 00000100:00100000:0.0:1779690443.722174:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317184 00000100:00080000:0.0:1779690443.722182:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690443.722194:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1779690443.722199:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492317056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690443.722300:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690443.722319:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492317696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690443.722350:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690443.722377:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317696 00000100:00100000:3.0:1779690443.722380:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317696 00000100:00100000:2.0:1779690443.722654:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492317824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690443.722685:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690443.722713:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492316928:12345-0@lo:400:kworker.0 Request processed in 739us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690443.722720:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1779690443.723554:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492317056:12345-0@lo:400:kworker.0 Request processed in 1353us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690443.723576:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1779690443.723592:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1779690443.723599:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492317568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.723635:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492317568:12345-0@lo:400:kworker.0 Request processed in 37us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690443.723641:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1779690443.723651:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1779690443.723658:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492317184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.723682:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492317184:12345-0@lo:400:kworker.0 Request processed in 25us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690443.723687:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1779690443.725098:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317440 00000100:00100000:1.0:1779690443.725106:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317440 00000100:00100000:1.0:1779690443.725146:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317312 00000100:00100000:1.0:1779690443.725149:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317312 00000100:00100000:1.0:1779690443.725174:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1779690443.725181:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492317440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.725230:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492317440:12345-0@lo:400:kworker.0 Request processed in 49us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690443.725236:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1779690443.725248:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1779690443.725254:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492317312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690443.725278:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492317312:12345-0@lo:400:kworker.0 Request processed in 25us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690443.725283:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:3.0:1779690443.726215:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492317824 00000100:00100000:3.0:1779690443.726232:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492317824 00000100:00100000:2.0:1779690443.726283:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1779690443.726295:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492317696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690443.726339:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690443.726470:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1779690443.726479:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492317824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690443.726498:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742195200 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690443.726518:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492317696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 225us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690443.726526:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1779690443.726535:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492317824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (3849us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690443.726543:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1779690443.726649:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492317824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690443.726661:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968408 gen 2 00000004:00080000:2.0:1779690443.726665:0:3321:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968408 committed transno 4294968408 00000100:00100000:2.0:1779690443.726688:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492317696:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1779690443.726856:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690443.726860:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690443.726880:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492317312:0@lo:400:kworker.0 00000100:00100000:3.0:1779690443.726892:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492317184:0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.729336:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492317056:0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.729352:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492317568:0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.729362:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492316928:0@lo:400:kworker.0 00000100:00100000:0.0:1779690443.729372:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492317440:0@lo:400:kworker.0 00000040:00080000:0.0:1779690444.041180:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690444.041188:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690444.041238:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 25 count 9 00000040:00080000:0.0:1779690444.041247:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690444.234051:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690444.868023:0:66154:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690444.868031:0:66154:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690444.870554:0:66154:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690444.870573:0:66154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690445.257947:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1779690445.473063:0:66202:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe5a5680e0 00000004:00000080:2.0:1779690445.473078:0:66202:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e2f88e3f000 uarg=0000000000000000 00000004:00000080:2.0:1779690445.473121:0:66202:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e2f88e3f000 00000040:00080000:2.0:1779690445.473438:0:66202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].5, 80 off8592 00000004:00000080:2.0:1779690445.473462:0:66202:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl5', mask 0x0 00000004:02000000:2.0:1779690445.473466:0:66202:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1779690445.569027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690445.570722:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503637376 00000100:00100000:1.0:1779690445.570733:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503637376 00000100:00100000:1.0:1779690445.570821:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 553 00000100:00100000:1.0:1779690445.570833:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+41:103981:x1866137503637376:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690445.570850:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690445.570868:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913eab9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc70 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570929:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570944:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570956:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570970:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570977:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.570984:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571070:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571078:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571085:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690445.571123:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00000004:00200000:1.0:1779690445.571126:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690445.571142:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571153:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571161:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571167:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571173:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571178:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690445.571182:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571188:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571199:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:1.0:1779690445.571201:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690445.571206:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571212:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eac0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571233:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571239:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571244:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571250:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690445.571252:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571258:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571265:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690445.571267:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690445.571270:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571275:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eac7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571313:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913eab9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 43 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571326:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690445.571343:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:1.0:1779690445.571345:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690445.571347:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690445.571405:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+42:103981:x1866137503637376:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 575us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690445.571412:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 553 00000100:00080000:2.0:1779690445.571574:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690445.576146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690445.576666:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503637504 00000100:00100000:2.0:1779690445.576675:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503637504 00000100:00100000:2.0:1779690445.576743:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6407 00000100:00100000:2.0:1779690445.576754:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503637504:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690445.576770:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690445.576785:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038d3ff47/0xb4bb873a1913ead5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc77 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690445.576897:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492317952:192.168.203.5@tcp:106: 00000100:00100000:2.0:1779690445.576977:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8d80 going to sleep for 11 seconds 00000100:00080000:3.0:1779690445.577038:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1779690445.578856:0:6581:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1779690445.578862:0:6581:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb mtime: 0 -> 1779690443 00002000:00010000:2.0:1779690445.578864:0:6581:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb atime: 0 -> 1779690443 00002000:00010000:2.0:1779690445.578865:0:6581:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb ctime: 0 -> 1779690443 00000100:00100000:2.0:1779690445.578886:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492317952:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690445.578914:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038d3ff47/0xb4bb873a1913ead5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc77 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690445.578936:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038d3ff47/0xb4bb873a1913ead5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc77 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690445.578946:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690445.578999:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503637504:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2247us (2859us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690445.579007:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6407 00000100:00100000:3.0:1779690445.586306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690445.586467:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503637632 00000100:00100000:0.0:1779690445.586489:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503637632 00000100:00100000:0.0:1779690445.586546:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 554 00000100:00100000:0.0:1779690445.586555:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+42:103981:x1866137503637632:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690445.586574:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690445.586591:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913eadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc7e expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586650:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586663:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586673:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690445.586727:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f:0x0]: returning size 512 00000004:00200000:0.0:1779690445.586731:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690445.586942:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586967:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913eadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586981:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 43 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.586990:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:0.0:1779690445.586993:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690445.586997:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f600, rc 0) 00000100:00100000:0.0:1779690445.587087:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+43:103981:x1866137503637632:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 533us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690445.587094:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 554 00000100:00100000:0.0:1779690445.591551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690445.591600:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503637760 00000100:00100000:1.0:1779690445.591610:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503637760 00000100:00100000:1.0:1779690445.591668:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6408 00000100:00100000:1.0:1779690445.591679:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503637760:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690445.591698:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690445.591716:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913eaea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc85 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690445.591776:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318080:192.168.203.5@tcp:106: 00000100:00100000:1.0:1779690445.591890:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c59240 going to sleep for 11 seconds 00000100:00100000:0.0:1779690445.593620:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318080:192.168.203.5@tcp:106: 00010000:00010000:0.0:1779690445.593662:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913eaea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc85 expref: 18 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.593685:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913eaea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc85 expref: 18 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690445.593695:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:0.0:1779690445.593750:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503637760:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2066us (2199us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690445.593758:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6408 00000100:00100000:3.0:1779690445.598529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690445.598620:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638016 00000100:00100000:0.0:1779690445.598629:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638016 00000100:00100000:0.0:1779690445.598687:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 555 00000100:00100000:0.0:1779690445.598696:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:103981:x1866137503638016:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1779690445.599086:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].25, 136 off11592 00000100:00100000:0.0:1779690445.599161:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:103981:x1866137503638016:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 466us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690445.599168:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 555 00000040:00080000:0.0:1779690446.089498:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690446.089506:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690446.089539:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 26 count 10 00000040:00080000:0.0:1779690446.089552:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690446.090138:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492318208:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690446.090896:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1779690446.093892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.093922:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638144 00000100:00100000:3.0:1779690446.093930:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638144 00000100:00100000:3.0:1779690446.093994:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 556 00000100:00100000:3.0:1779690446.094003:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503638144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690446.094038:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690446.094131:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503638144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.094138:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 556 00000100:00080000:3.0:1779690446.094168:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690446.095225:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492318208:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690446.098655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.100916:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638400 00000100:00100000:0.0:1779690446.100928:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638400 00000100:00100000:0.0:1779690446.101983:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 557 00000100:00100000:0.0:1779690446.101996:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+44:103991:x1866137503638400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690446.102017:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690446.102035:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913eaf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc8c expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.102126:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eaf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.102140:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.102151:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690446.102161:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00010000:00010000:0.0:1779690446.102280:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913eaf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc8c expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.102305:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc8c expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.102313:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:0.0:1779690446.102315:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690446.102325:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690446.103112:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:103991:x1866137503638400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1117us (4613us total) trans 12884902139 rc 0/0 00000100:00100000:0.0:1779690446.103121:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 557 00000100:00100000:3.0:1779690446.105845:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.105883:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638528 00000100:00100000:3.0:1779690446.105892:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638528 00000100:00100000:3.0:1779690446.105947:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6409 00000100:00100000:3.0:1779690446.105956:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503638528:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690446.105996:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.106017:0:49882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.106025:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690446.106027:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690446.106030:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.106062:0:49882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.106076:0:49882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 8 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.106089:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492318336:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690446.106164:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfc0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1779690446.106184:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690446.107445:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690446.109510:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638656 00000100:00100000:1.0:1779690446.109521:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638656 00000100:00100000:1.0:1779690446.109589:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18660 00000100:00100000:1.0:1779690446.109598:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+46:2392:x1866137503638656:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690446.109612:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690446.109635:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eaf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc8c expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.109659:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:1.0:1779690446.109664:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690446.109726:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+45:2392:x1866137503638656:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 129us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690446.109741:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18660 00000100:00100000:2.0:1779690446.121951:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492318336:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690446.121982:0:49882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690446.123545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.130850:0:6586:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638784 00000100:00100000:0.0:1779690446.130865:0:6586:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638784 00002000:00100000:0.0:1779690446.130918:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1eb:0x0] (0->1515) req@ffff9e2f81e96680 x1866137503638784/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:682/0 lens 2008/0 e 0 to 0 dl 1779690457 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690446.130928:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e96680 with x1866137503638784 ext(0->1515) 00010000:00010000:0.0:1779690446.130937:0:6586:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 9 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.130954:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 9 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690446.130961:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f81e96680 00000100:00100000:0.0:1779690446.130994:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1779690446.131003:0:6586:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503638784:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:0.0:1779690446.133229:0:6586:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503638784:12345-192.168.203.5@tcp:4:cp.0 Request processed in 2218us (9683us total) trans 4294968341 rc 0/0 00000100:00100000:0.0:1779690446.133240:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00002000:00100000:0.0:1779690446.133252:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1eb:0x0] (0->1515) req@ffff9e2f81e96680 x1866137503638784/t4294968341(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:682/0 lens 2008/448 e 0 to 0 dl 1779690457 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690446.133262:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e96680 with x1866137503638784 ext(0->1515) 00010000:00010000:0.0:1779690446.133270:0:6586:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.133304:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690446.133311:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f81e96680 00000100:00100000:2.0:1779690446.136922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.136955:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503638912 00000100:00100000:2.0:1779690446.136965:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503638912 00010000:00010000:2.0:1779690446.137001:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690446.137034:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3233 00000100:00100000:2.0:1779690446.137042:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503638912:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690446.137055:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690446.137076:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.137090:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.137112:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d1fb58/0xb4bb873a1913eab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc69 expref: 11 pid: 49882 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.137137:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690446.137139:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690446.137144:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.137152:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.137178:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690446.137222:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503638912:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 180us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690446.137229:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3233 00010000:00010000:2.0:1779690446.138532:0:49882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138561:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138592:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138610:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138618:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138632:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812adc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690446.138636:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138645:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138661:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.138669:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b586c20/0xb4bb873a1913eb06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690446.138754:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503638528:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 32797us (32914us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690446.138761:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6409 00000100:00100000:3.0:1779690446.151263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.151302:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639168 00000100:00100000:3.0:1779690446.151311:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639168 00000100:00100000:3.0:1779690446.151353:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 558 00000100:00100000:3.0:1779690446.151361:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503639168:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690446.151468:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503639168:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.151475:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 558 00000100:00100000:3.0:1779690446.154127:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.154162:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639296 00000100:00100000:3.0:1779690446.154171:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639296 00000100:00100000:3.0:1779690446.154214:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6410 00000100:00100000:3.0:1779690446.154222:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503639296:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690446.154238:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690446.154258:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc93 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690446.154300:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1eb:0x0] initial LVB size: 1516, mtime: 0x6a13ebcb, atime: 0x0, ctime: 0x6a13ebcb, blocks: 0x1 00010000:00010000:3.0:1779690446.154317:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690446.154320:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690446.154327:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.154345:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.154358:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad600, rc 0) 00000100:00100000:3.0:1779690446.154414:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503639296:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 193us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.154421:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6410 00000100:00100000:2.0:1779690446.166037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.166146:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639552 00000100:00100000:2.0:1779690446.166154:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639552 00000100:00100000:2.0:1779690446.166201:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 559 00000100:00100000:2.0:1779690446.166211:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503639552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690446.166321:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503639552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690446.166329:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 559 00000100:00100000:0.0:1779690446.172180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690446.172241:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639680 00000100:00100000:1.0:1779690446.172250:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639680 00002000:00100000:1.0:1779690446.172304:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1eb:0x0] (0->4095) req@ffff9e2f963e6680 x1866137503639680/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:682/0 lens 488/0 e 0 to 0 dl 1779690457 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690446.172315:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f963e6680 with x1866137503639680 ext(0->4095) 00002000:00010000:1.0:1779690446.172322:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f963e6680 00000100:00100000:1.0:1779690446.172350:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2046 00000100:00100000:1.0:1779690446.172358:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503639680:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1779690446.172583:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503639680:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 225us (410us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1779690446.172591:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2046 00002000:00100000:1.0:1779690446.172597:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1eb:0x0] (0->4095) req@ffff9e2f963e6680 x1866137503639680/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:682/0 lens 488/4536 e 0 to 0 dl 1779690457 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690446.172605:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f963e6680 with x1866137503639680 ext(0->4095) 00002000:00010000:1.0:1779690446.172608:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f963e6680 00000100:00100000:3.0:1779690446.176246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.176322:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639808 00000100:00100000:0.0:1779690446.176332:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639808 00000100:00100000:0.0:1779690446.176388:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 560 00000100:00100000:0.0:1779690446.176398:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:103991:x1866137503639808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690446.176416:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690446.176435:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913eb14 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedc9a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176469:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176483:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176493:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176584:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913eb14 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176612:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.176631:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:0.0:1779690446.176634:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690446.176638:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:0.0:1779690446.176694:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:103991:x1866137503639808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 297us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.176701:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 560 00000100:00100000:0.0:1779690446.186355:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.186397:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503639936 00000100:00100000:3.0:1779690446.186407:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503639936 00000100:00100000:3.0:1779690446.186471:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 561 00000100:00100000:3.0:1779690446.186481:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:103991:x1866137503639936:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690446.186512:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690446.186615:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:103991:x1866137503639936:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 135us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.186624:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 561 00000100:00100000:0.0:1779690446.194991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.195059:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503640064 00000100:00100000:3.0:1779690446.195069:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503640064 00000100:00100000:3.0:1779690446.195123:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6411 00000100:00100000:3.0:1779690446.195134:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503640064:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690446.195176:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195192:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690446.195194:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690446.195199:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195212:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195253:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195261:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195269:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195276:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690446.195280:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195300:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195316:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.195324:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c8a7f9/0xb4bb873a1913eb22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.195394:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503640064:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 262us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.195411:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6411 00000100:00100000:3.0:1779690446.201080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.204375:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503640320 00000100:00100000:2.0:1779690446.204386:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503640320 00000100:00100000:2.0:1779690446.204471:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 562 00000100:00100000:2.0:1779690446.204482:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:103991:x1866137503640320:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690446.204560:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.204577:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.204584:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.204616:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.204630:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 46 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690446.204645:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492318464:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690446.204745:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3081254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1779690446.213215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.213248:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503640448 00000100:00100000:3.0:1779690446.213257:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503640448 00010000:00010000:3.0:1779690446.213310:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.213346:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3234 00000100:00100000:1.0:1779690446.213351:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492318464:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690446.213359:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503640448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690446.213372:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690446.213378:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.213388:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.213403:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.213440:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913eb1b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc9a expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.215110:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690446.215119:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.215131:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.215150:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.215182:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690446.215244:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+46:2391:x1866137503640448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1886us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.215253:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3234 00010000:00010000:3.0:1779690446.215302:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.215310:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690446.219314:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902140 00010000:00010000:3.0:1779690446.219345:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219356:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219363:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219370:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690446.219373:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219381:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219880:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690446.219889:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690446.219896:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.219904:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913eb29 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.220103:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:103991:x1866137503640320:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 15618us (19024us total) trans 12884902141 rc 0/0 00000100:00100000:3.0:1779690446.220112:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 562 00000020:00080000:3.0:1779690446.220119:0:57559:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1779690446.220236:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690446.220240:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690446.220852:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:3.0:1779690446.220861:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690446.223316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.223455:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503640704 00000100:00100000:3.0:1779690446.223464:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503640704 00000100:00100000:3.0:1779690446.223516:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:3.0:1779690446.223527:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103991:x1866137503640704:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690446.223847:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+48:103991:x1866137503640704:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 321us (537us total) trans 12884902142 rc 0/0 00000100:00100000:3.0:1779690446.223854:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000040:00080000:0.0:1779690446.224854:0:66251:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690446.224861:0:66251:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690446.224929:0:66251:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 26 count 10 00000040:00080000:0.0:1779690446.224936:0:66251:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690446.259034:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.259464:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503640832 00000100:00100000:0.0:1779690446.259474:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503640832 00000100:00100000:0.0:1779690446.259525:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6412 00000100:00100000:0.0:1779690446.259534:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503640832:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690446.259549:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690446.259565:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedca1 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.259587:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690446.259589:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690446.259596:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.259613:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.259632:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f400, rc 0) 00000100:00100000:0.0:1779690446.259689:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+18:2390:x1866137503640832:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 157us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.259697:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6412 00000100:00100000:3.0:1779690446.267486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690446.267562:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641088 00000100:00100000:1.0:1779690446.267572:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641088 00000100:00100000:1.0:1779690446.267630:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 563 00000100:00100000:1.0:1779690446.267641:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:103992:x1866137503641088:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690446.267660:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690446.267681:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eb37 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedca8 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.267775:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.267792:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.267822:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690446.267835:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00010000:00010000:1.0:1779690446.267955:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913eb37 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca8 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.267972:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca8 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.267980:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:1.0:1779690446.267983:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1779690446.267986:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690446.268037:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+45:103992:x1866137503641088:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 399us (559us total) trans 12884902143 rc 0/0 00000100:00100000:1.0:1779690446.268052:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 563 00000100:00100000:3.0:1779690446.272350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.272494:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.272538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.272549:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641216 00000100:00100000:0.0:1779690446.272557:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641344 00000100:00100000:2.0:1779690446.272559:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641216 00000100:00100000:0.0:1779690446.272563:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641344 00000100:00100000:2.0:1779690446.272614:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:2.0:1779690446.272625:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503641216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690446.272671:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641472 00000100:00100000:0.0:1779690446.272675:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641472 00000100:00100000:3.0:1779690446.272683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.272692:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503641216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.272706:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641600 00000100:00100000:0.0:1779690446.272710:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641600 00000100:00100000:2.0:1779690446.272713:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:0.0:1779690446.272738:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2848 00000100:00100000:0.0:1779690446.272747:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503641344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690446.272763:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2849 00000100:00100000:2.0:1779690446.272773:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503641472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690446.272789:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503641344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.272797:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2848 00000100:00100000:0.0:1779690446.272833:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6413 00000100:00100000:2.0:1779690446.272843:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+15:2392:x1866137503641472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.272844:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2390:x1866137503641600:12345-192.168.203.5@tcp:1:lfs.0 00000100:00100000:2.0:1779690446.272858:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2849 00010000:00010000:0.0:1779690446.272883:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.272905:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 9 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.272925:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.272940:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690446.272942:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690446.272946:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.272982:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 18 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.272996:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 18 pid: 6581 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690446.273010:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318592:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690446.273083:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 9 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.273095:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 9 pid: 10273 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690446.273105:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318720:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690446.273146:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c600 going to sleep for 11 seconds 00000100:00080000:0.0:1779690446.273161:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690446.277055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.277180:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318592:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690446.277200:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492318720:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690446.277235:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690446.277238:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641728 00000100:00100000:1.0:1779690446.277246:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641728 00010000:00010000:1.0:1779690446.277293:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 19 pid: 6581 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690446.277359:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3235 00000100:00100000:1.0:1779690446.277369:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503641728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690446.277383:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690446.277403:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 19 pid: 6581 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.277416:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 19 pid: 6581 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.277437:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913eb30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca1 expref: 19 pid: 6581 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.277452:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690446.277512:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+18:2391:x1866137503641728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 144us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690446.277519:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3235 00000100:00100000:0.0:1779690446.278482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690446.278540:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503641856 00000100:00100000:1.0:1779690446.278547:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503641856 00010000:00010000:1.0:1779690446.278572:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690446.278620:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3236 00000100:00100000:1.0:1779690446.278629:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503641856:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690446.278640:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690446.278655:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.278666:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.278683:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ff83c9/0xb4bb873a1913eb0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc93 expref: 10 pid: 10273 timeout: 3273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.278694:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690446.278695:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690446.278700:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.278708:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.278741:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690446.278773:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503641856:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 145us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690446.278780:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3236 00010000:00010000:3.0:1779690446.279291:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279302:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279326:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279334:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279341:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279348:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690446.279352:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279360:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279373:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.279380:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913eb4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.279475:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503641600:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 6635us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.279483:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6413 00010000:00010000:2.0:1779690446.281969:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690446.287137:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.287405:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503642112 00000100:00100000:3.0:1779690446.287415:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503642112 00000100:00100000:3.0:1779690446.287460:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:3.0:1779690446.287471:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+45:103992:x1866137503642112:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:3.0:1779690446.287530:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca8 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690446.289565:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902144 00000001:00080000:3.0:1779690446.292393:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902145 00010000:00010000:3.0:1779690446.292490:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292510:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292520:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292528:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292567:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292593:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 48 pid: 57559 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.292608:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492318848:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690446.292711:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.292721:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.292731:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492318976:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690446.297322:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfca80 going to sleep for 11 seconds 00000100:00100000:3.0:1779690446.305123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.305169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.305200:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503642368 00000100:00100000:3.0:1779690446.305209:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503642368 00010000:00010000:3.0:1779690446.305246:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 48 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.305277:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503642240 00000100:00100000:3.0:1779690446.305576:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503642240 00010000:00010000:3.0:1779690446.305596:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 49 pid: 57559 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.305620:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3237 00000100:00100000:3.0:1779690446.305629:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+48:2391:x1866137503642368:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690446.305662:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690446.305669:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 48 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.305680:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 48 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.305702:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690446.305707:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.305714:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.305720:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690446.306001:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+48:2391:x1866137503642368:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 234us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.306009:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3237 00000100:00100000:3.0:1779690446.306032:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3238 00000100:00100000:3.0:1779690446.306040:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+49:2392:x1866137503642240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690446.306049:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690446.306055:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 49 pid: 57559 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.306066:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 49 pid: 57559 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.306089:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:3.0:1779690446.306093:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.306101:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.306109:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.306127:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690446.306726:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+49:2392:x1866137503642240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 684us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.307469:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3238 00010000:00010000:3.0:1779690446.307609:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913eace lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc70 expref: 48 pid: 57559 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.307789:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492318848:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690446.307822:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913ea9d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc5b expref: 47 pid: 57561 timeout: 3273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690446.307834:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492318976:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690446.307853:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.307862:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.307877:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690446.308138:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902146 00000001:00080000:3.0:1779690446.308673:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902147 00000001:00080000:3.0:1779690446.308837:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902148 00000100:00100000:3.0:1779690446.308924:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492319104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690446.308978:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690446.309021:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492319104 00000100:00100000:3.0:1779690446.309026:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492319104 00000100:00100000:3.0:1779690446.309074:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449 00000100:00100000:3.0:1779690446.309081:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492319104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690446.309139:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492319104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.309147:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449 00000100:00100000:3.0:1779690446.309169:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690446.309187:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492319104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1779690446.309612:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902149 00000100:00100000:3.0:1779690446.309662:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492319232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690446.309687:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690446.309716:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfca80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690446.311348:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492319232 00000100:00100000:1.0:1779690446.311357:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492319232 00000100:00100000:1.0:1779690446.311398:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450 00000100:00100000:1.0:1779690446.311407:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492319232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1779690446.311612:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492319232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 206us (1923us total) trans 4294968342 rc 0/0 00000100:00100000:1.0:1779690446.311620:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450 00000100:00100000:1.0:1779690446.311668:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492319232:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:1.0:1779690446.311690:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311700:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311708:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311713:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690446.311718:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311726:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311741:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:1.0:1779690446.311744:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1779690446.311748:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.311754:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913eb53 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690446.312265:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x80:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1779690446.312435:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].7, 64 off8688 00000004:00080000:1.0:1779690446.312447:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3173886640943ns, next at 3174886637958ns, rc = 0 00000001:00080000:1.0:1779690446.312455:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902150 00010000:00010000:1.0:1779690446.312536:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f883cb700) 00010000:00010000:1.0:1779690446.312540:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1779690446.312547:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913eb3e lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedca8 expref: 52 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690446.312756:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902151 00000100:00100000:1.0:1779690446.312863:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+52:103992:x1866137503642112:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 25395us (25733us total) trans 12884902152 rc 0/0 00000100:00100000:1.0:1779690446.312871:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000020:00080000:1.0:1779690446.312876:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1779690446.313310:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690446.324964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690446.325030:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503642624 00000100:00100000:2.0:1779690446.325039:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503642624 00000100:00100000:2.0:1779690446.325090:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 564 00000100:00100000:2.0:1779690446.325100:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+52:103993:x1866137503642624:12345-192.168.203.5@tcp:101:md5sum.0 00010000:00010000:2.0:1779690446.325124:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690446.325143:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913eb5a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcaf expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325206:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325220:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325232:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325244:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325261:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325268:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325617:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913eb6f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325626:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913eb6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325632:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913eb6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690446.325641:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00010000:00010000:2.0:1779690446.325722:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325731:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325737:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325742:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690446.325746:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325753:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325774:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690446.325776:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690446.325781:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325787:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eb61 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325797:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325836:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325843:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325848:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690446.325851:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325856:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325864:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xadbb615b (ffff9e2f826ec600) 00010000:00010000:2.0:1779690446.325866:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690446.325869:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325875:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eb68 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0xadbb615b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325928:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913eb5a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcaf expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325943:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913eb6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcaf expref: 54 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690446.325950:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690446.325952:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690446.325955:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690446.326007:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:103993:x1866137503642624:12345-192.168.203.5@tcp:101:md5sum.0 Request processed in 908us (1052us total) trans 12884902153 rc 0/0 00000100:00100000:2.0:1779690446.326014:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 564 00000001:00080000:0.0:1779690446.327573:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902139 is committed 00000001:00080000:0.0:1779690446.327590:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902136 is committed 00000001:00080000:0.0:1779690446.327603:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902143 is committed 00000020:00080000:0.0:1779690446.327618:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018964 batchid updated 00000001:00080000:0.0:1779690446.327635:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902142 is committed 00000020:00080000:0.0:1779690446.327657:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018964 00000020:00080000:0.0:1779690446.327666:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018964 00000100:00100000:1.0:1779690446.336433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690446.336677:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503642880 00000100:00100000:0.0:1779690446.336686:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503642880 00000100:00100000:0.0:1779690446.336750:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18661 00000100:00100000:0.0:1779690446.336762:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+52:103993:x1866137503642880:12345-192.168.203.5@tcp:103:md5sum.0 00010000:00010000:0.0:1779690446.336777:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690446.336820:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913eb6f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcaf expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690446.336838:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:0.0:1779690446.336849:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690446.337101:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:103993:x1866137503642880:12345-192.168.203.5@tcp:103:md5sum.0 Request processed in 340us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690446.337110:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18661 00000100:00100000:3.0:1779690446.341121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690446.341197:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643008 00000100:00100000:1.0:1779690446.341206:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643008 00000100:00100000:1.0:1779690446.341268:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 565 00000100:00100000:1.0:1779690446.341277:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:103993:x1866137503643008:12345-192.168.203.5@tcp:58:md5sum.0 00010000:00010000:1.0:1779690446.341381:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.341397:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690446.341409:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1779690446.341728:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].26, 136 off11728 00000100:00100000:1.0:1779690446.341834:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:103993:x1866137503643008:12345-192.168.203.5@tcp:58:md5sum.0 Request processed in 529us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690446.341842:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 565 00000100:00100000:1.0:1779690446.348220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690446.348297:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643136 00000100:00100000:3.0:1779690446.348306:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643136 00000100:00100000:3.0:1779690446.348349:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 566 00000100:00100000:3.0:1779690446.348357:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:103993:x1866137503643136:12345-192.168.203.5@tcp:101:md5sum.0 00010000:00010000:3.0:1779690446.348380:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690446.348397:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcb6 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348445:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 2/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348454:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 4/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348470:0:57585:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348481:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348491:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690446.348493:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1779690446.348496:0:57585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690446.348503:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf4c5600, rc 0) 00000100:00100000:3.0:1779690446.348556:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:103993:x1866137503643136:12345-192.168.203.5@tcp:101:md5sum.0 Request processed in 200us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690446.348562:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 566 00000040:00080000:3.0:1779690447.241044:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690447.241053:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690447.241090:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 27 count 11 00000040:00080000:3.0:1779690447.241107:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690447.241216:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492319360:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690447.241329:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8bbfc240 going to sleep for 11 seconds 00000100:00100000:1.0:1779690447.247462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.247568:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492319360:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690447.247861:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643264 00000100:00100000:0.0:1779690447.247869:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643264 00000100:00100000:0.0:1779690447.247934:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 567 00000100:00100000:0.0:1779690447.247943:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:103994:x1866137503643264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690447.247973:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690447.248084:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:103994:x1866137503643264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 142us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.248091:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 567 00000100:00100000:2.0:1779690447.255966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.256058:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643392 00000100:00100000:3.0:1779690447.256067:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643392 00000100:00100000:3.0:1779690447.256125:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 568 00000100:00100000:3.0:1779690447.256135:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:103994:x1866137503643392:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1779690447.256198:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256217:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256229:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256291:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256300:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256306:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256329:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256337:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.256356:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690447.258241:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00000004:00200000:3.0:1779690447.258249:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690447.258267:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258297:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258304:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258312:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258317:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf4c5200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690447.258538:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258548:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258562:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690447.258565:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690447.258569:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258576:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5200/0xb4bb873a1913eb8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258829:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258837:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258843:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258848:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690447.258851:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258857:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258866:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xea082eb2 (ffff9e2f905ad200) 00010000:00010000:3.0:1779690447.258868:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690447.258871:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258876:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913eb92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xea082eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258892:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258898:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258904:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258915:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690447.258918:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258924:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258932:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:3.0:1779690447.258934:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690447.258937:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.258942:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913eb99 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690447.259032:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:103994:x1866137503643392:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 2895us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.259042:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 568 00000100:00100000:1.0:1779690447.262579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690447.263221:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643648 00000100:00100000:2.0:1779690447.263230:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643648 00000100:00100000:2.0:1779690447.263321:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 569 00000100:00100000:2.0:1779690447.263331:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:103994:x1866137503643648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690447.263351:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690447.263386:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eba0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcbd expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263476:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263491:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263518:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690447.263531:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x19:0x0]: returning size 1516 00010000:00010000:2.0:1779690447.263629:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263637:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263642:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263647:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690447.263650:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263656:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263666:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:2.0:1779690447.263669:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690447.263673:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263678:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913eba7 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263712:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eba0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcbd expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.263999:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690447.264001:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690447.264006:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913eba0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcbd expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.264016:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c200, rc 0) 00000100:00100000:2.0:1779690447.264146:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:103994:x1866137503643648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 816us (1573us total) trans 12884902154 rc 301/301 00000100:00100000:2.0:1779690447.264154:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 569 00000100:00100000:1.0:1779690447.267202:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.267299:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503643776 00000100:00100000:3.0:1779690447.267307:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503643776 00000100:00100000:3.0:1779690447.267512:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 570 00000100:00100000:3.0:1779690447.267524:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:103994:x1866137503643776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690447.267556:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690447.267648:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:103994:x1866137503643776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 126us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.270148:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 570 00000100:00100000:1.0:1779690447.270946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.271143:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644032 00000100:00100000:0.0:1779690447.271152:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644032 00000100:00100000:0.0:1779690447.271268:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 571 00000100:00100000:0.0:1779690447.271286:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:103994:x1866137503644032:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.271305:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.271324:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcc4 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.272350:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ebbc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.272365:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ebbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.272376:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ebbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690447.272386:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1a:0x0]: returning size 0 00010000:00010000:0.0:1779690447.272428:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcc4 expref: 43 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.272444:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ebbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcc4 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.272460:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690447.272463:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690447.272466:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690447.272527:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503644032:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1241us (1678us total) trans 12884902155 rc 0/0 00000100:00100000:0.0:1779690447.272535:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 571 00000100:00100000:2.0:1779690447.275933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.276259:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644288 00000100:00100000:1.0:1779690447.276269:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644288 00000100:00100000:1.0:1779690447.276371:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 572 00000100:00100000:1.0:1779690447.276418:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503644288:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690447.276477:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690447.276501:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ebbc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcc4 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.276518:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690447.276528:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690447.276548:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.276561:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 51 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.276569:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.276627:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 51 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.276641:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 51 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.276654:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492319488:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690447.276740:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c59f00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690447.279782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690447.280533:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644416 00000100:00100000:2.0:1779690447.280543:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644416 00010000:00010000:2.0:1779690447.280649:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 52 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690447.280733:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690447.280770:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3239 00000100:00100000:2.0:1779690447.280780:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+52:2392:x1866137503644416:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690447.280796:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690447.280827:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 52 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.280841:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 52 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.280870:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:2.0:1779690447.280888:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.280898:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.280905:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.280924:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690447.280974:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+52:2392:x1866137503644416:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 195us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690447.280982:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3239 00010000:00010000:0.0:1779690447.281190:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913eae3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc7e expref: 51 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.281205:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492319488:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690447.281223:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.281231:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.281237:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.281256:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.281265:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.281283:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.282975:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.282988:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.282994:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.282999:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.283003:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283011:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283025:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:0.0:1779690447.283027:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690447.283031:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283097:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ebca lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283112:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283117:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283122:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283134:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.283137:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283142:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283151:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0xf88148ff (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690447.283153:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690447.283156:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.283162:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f:0x0].0xf88148ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.283301:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503644288:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 6883us (7371us total) trans 0 rc -2/-2 00000100:00100000:0.0:1779690447.283310:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 572 00000100:00100000:1.0:1779690447.286783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.287133:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644544 00000100:00100000:3.0:1779690447.287153:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644544 00000100:00100000:3.0:1779690447.287237:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 573 00000100:00100000:3.0:1779690447.287247:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503644544:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690447.287266:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690447.287294:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913ebd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedccb expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287329:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287342:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287353:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287549:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913ebd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 43 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287566:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.287575:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:3.0:1779690447.287578:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690447.287581:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:3.0:1779690447.287643:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503644544:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 397us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.287650:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 573 00000100:00100000:1.0:1779690447.290138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.290194:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644800 00000100:00100000:0.0:1779690447.290200:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644800 00000100:00100000:0.0:1779690447.290245:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 574 00000100:00100000:0.0:1779690447.290254:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503644800:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.290334:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.290349:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.290358:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690447.290896:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000095dab232 reply state 00000000ce3409ef transno 12884902156 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.290906:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690447.290979:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+44:103994:x1866137503644800:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 725us (845us total) trans 12884902156 rc 0/0 00000100:00100000:0.0:1779690447.290987:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 574 00010000:00010000:1.0:1779690447.293308:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293324:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293332:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293337:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690447.293341:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293350:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293366:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:1.0:1779690447.293378:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1779690447.293383:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.293389:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913ebe6 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690447.293622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.293711:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503644928 00000100:00100000:0.0:1779690447.293766:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503644928 00000100:00100000:0.0:1779690447.293835:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 575 00000100:00100000:0.0:1779690447.293845:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+43:103994:x1866137503644928:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.293974:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.293989:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcd2 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.294038:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.294051:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.294164:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:0.0:1779690447.294167:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690447.294169:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ee00, rc 0) 00000100:00100000:0.0:1779690447.294224:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+44:103994:x1866137503644928:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 379us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.294242:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 575 00000100:00100000:1.0:1779690447.296534:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.296713:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503645056 00000100:00100000:3.0:1779690447.296738:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503645056 00000100:00100000:3.0:1779690447.296787:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:3.0:1779690447.296796:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+44:103994:x1866137503645056:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1779690447.297252:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+44:103994:x1866137503645056:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 455us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.297260:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1779690447.299552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.299630:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503645312 00000100:00100000:3.0:1779690447.299639:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503645312 00000100:00100000:3.0:1779690447.299699:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:3.0:1779690447.299709:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90559c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+44:103994:x1866137503645312:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690447.299942:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90559c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503645312:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 234us (398us total) trans 12884902157 rc 0/0 00000100:00100000:3.0:1779690447.299949:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1779690447.302317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.302848:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503645568 00000100:00100000:3.0:1779690447.302856:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503645568 00000100:00100000:3.0:1779690447.302941:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 576 00000100:00100000:3.0:1779690447.302951:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503645568:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690447.303049:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503645568:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 100us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.303056:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 576 00000100:00100000:1.0:1779690447.305966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.306064:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503645824 00000100:00100000:0.0:1779690447.306074:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503645824 00000100:00100000:0.0:1779690447.306126:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 577 00000100:00100000:0.0:1779690447.306136:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503645824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.306154:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.306173:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913ebf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcd9 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.306279:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.306294:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.306301:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.306331:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.306343:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 46 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.306356:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492319616:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690447.306436:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1779690447.306829:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690447.309625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.309704:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503645952 00000100:00100000:3.0:1779690447.309712:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503645952 00010000:00010000:3.0:1779690447.309756:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 47 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690447.309847:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3240 00000100:00100000:3.0:1779690447.309857:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+47:2392:x1866137503645952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690447.309871:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690447.309877:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 47 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.309889:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 47 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.309909:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:3.0:1779690447.309914:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.309923:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.309929:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.309948:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690447.309991:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+47:2392:x1866137503645952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.309998:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3240 00010000:00010000:0.0:1779690447.310484:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ebed lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd2 expref: 46 pid: 57561 timeout: 3274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.310508:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492319616:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690447.310528:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.310535:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.310540:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690447.310557:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1a:0x0]: returning size 0 00000004:00080000:0.0:1779690447.311084:0:64445:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1eb:0x0], index 1: 0 00010000:00010000:0.0:1779690447.311229:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311237:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311244:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311249:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.311253:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311266:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311288:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:0.0:1779690447.311296:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690447.311301:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311306:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ebfb lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311352:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913ebf4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd9 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311361:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f:0x0].0x0 (ffff9e2f903c9500) 00010000:00010000:0.0:1779690447.311364:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690447.311368:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913ebf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcd9 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.311376:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f600, rc 0) 00000100:00100000:0.0:1779690447.311421:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503645824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5287us (5463us total) trans 12884902158 rc 301/301 00000100:00100000:0.0:1779690447.311429:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 577 00000100:00100000:1.0:1779690447.314588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.314858:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646208 00000100:00100000:0.0:1779690447.314867:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646208 00000100:00100000:0.0:1779690447.314920:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:0.0:1779690447.314930:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+45:103994:x1866137503646208:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000001:00080000:0.0:1779690447.315469:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902159 00000100:00100000:0.0:1779690447.315602:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+47:103994:x1866137503646208:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 668us (1016us total) trans 12884902160 rc 0/0 00000100:00100000:0.0:1779690447.315619:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000020:00080000:0.0:1779690447.315624:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1779690447.317503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.317866:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646336 00000100:00100000:0.0:1779690447.317875:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646336 00000100:00100000:0.0:1779690447.317922:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 578 00000100:00100000:0.0:1779690447.317931:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103994:x1866137503646336:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.317951:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.317968:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ec09 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedce0 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318032:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318057:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318067:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690447.318096:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1779690447.318110:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690447.318128:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318150:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ec09 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce0 expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318165:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce0 expref: 48 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.318173:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:0.0:1779690447.318176:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1779690447.318189:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fe00, rc 0) 00000100:00100000:0.0:1779690447.318517:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+48:103994:x1866137503646336:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 586us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.318525:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 578 00000100:00100000:2.0:1779690447.321370:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.321676:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646464 00000100:00100000:0.0:1779690447.321685:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646464 00000100:00100000:0.0:1779690447.321905:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6414 00000100:00100000:0.0:1779690447.321916:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503646464:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.321934:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.321953:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedce7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690447.321979:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1779690447.321998:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690447.322000:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690447.322008:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 11 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.322024:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 11 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.322047:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f600, rc 0) 00000100:00100000:0.0:1779690447.322106:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503646464:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 192us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.322114:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6414 00000100:00100000:1.0:1779690447.324759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.324864:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646720 00000100:00100000:3.0:1779690447.324872:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646720 00000100:00100000:3.0:1779690447.324921:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 579 00000100:00100000:3.0:1779690447.324929:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:103994:x1866137503646720:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690447.325151:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:103994:x1866137503646720:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 221us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690447.325160:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 579 00000100:00100000:2.0:1779690447.327935:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.328103:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646848 00000100:00100000:0.0:1779690447.328111:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646848 00000100:00100000:0.0:1779690447.328183:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6415 00000100:00100000:0.0:1779690447.328190:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+11:103994:x1866137503646848:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.328204:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690447.328218:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcee expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.328241:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.328247:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690447.328249:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690447.328251:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.328285:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.328301:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 3274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.328315:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492319744:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690447.328436:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90a1c300 going to sleep for 11 seconds 00000100:00100000:2.0:1779690447.331609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.331970:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492319744:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690447.332012:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503646976 00000100:00100000:1.0:1779690447.332019:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503646976 00010000:00010000:0.0:1779690447.332076:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.332116:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f000, rc 0) 00010000:00010000:1.0:1779690447.332125:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 13 pid: 22747 timeout: 3274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.332155:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3241 00000100:00100000:1.0:1779690447.332164:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503646976:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1779690447.332171:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:103994:x1866137503646848:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3981us (4378us total) trans 0 rc 0/0 00010000:00010000:1.0:1779690447.332176:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1779690447.332177:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6415 00010000:00010000:1.0:1779690447.332196:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 3274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.332208:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 3274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.332235:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f1b8036/0xb4bb873a1913ec17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce7 expref: 12 pid: 22747 timeout: 3274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.332255:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.332256:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.332263:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.332285:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.332319:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.332332:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5779:1866137492319872:192.168.203.5@tcp:105: 00000100:00100000:1.0:1779690447.332446:0:5779:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c59780 going to sleep for 11 seconds 00000100:00100000:0.0:1779690447.334087:0:5779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5779:1866137492319872:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690447.334551:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690447.334601:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503646976:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2437us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.334610:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3241 00000100:00100000:2.0:1779690447.336695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.336776:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647104 00000100:00100000:1.0:1779690447.336786:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647104 00002000:00100000:1.0:1779690447.336861:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1eb:0x0] (0->1515) req@ffff9e2f89d3fb80 x1866137503647104/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:683/0 lens 2008/0 e 0 to 0 dl 1779690458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690447.336872:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f89d3fb80 with x1866137503647104 ext(0->1515) 00002000:00010000:1.0:1779690447.336878:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f89d3fb80 00000100:00100000:1.0:1779690447.336909:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2047 00000100:00100000:1.0:1779690447.336918:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503647104:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1779690447.337752:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503647104:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 832us (1062us total) trans 4294968409 rc 0/0 00000100:00100000:1.0:1779690447.337760:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2047 00002000:00100000:1.0:1779690447.337773:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1eb:0x0] (0->1515) req@ffff9e2f89d3fb80 x1866137503647104/t4294968409(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:683/0 lens 2008/448 e 0 to 0 dl 1779690458 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690447.337780:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f89d3fb80 with x1866137503647104 ext(0->1515) 00002000:00010000:1.0:1779690447.337783:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f89d3fb80 00000100:00100000:2.0:1779690447.344086:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.344183:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647232 00000100:00100000:0.0:1779690447.344192:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647232 00000100:00100000:0.0:1779690447.344246:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 580 00000100:00100000:0.0:1779690447.344256:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+48:103994:x1866137503647232:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1779690447.389666:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902160 is committed 00000001:00080000:1.0:1779690447.389691:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902152 is committed 00000004:00080000:1.0:1779690447.389698:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1779690447.389712:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902153 is committed 00000020:00080000:1.0:1779690447.389726:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f8bbfc780 refcount 2 committed 0 result 0 batchid 8590018965 00000020:00080000:1.0:1779690447.389730:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3089c40a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e308359a9c0 00000020:00080000:1.0:1779690447.389733:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3089c40400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e30b1b5c000 00000100:00100000:2.0:1779690447.389773:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503647232:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 45514us (45691us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690447.389783:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 580 00000020:00080000:1.0:1779690447.389890:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018965 committed batchid 8590018964 00000020:00080000:1.0:1779690447.390046:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018964 00000100:00100000:1.0:1779690447.390063:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492320000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1779690447.390109:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690447.390292:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492320000 00000100:00100000:3.0:1779690447.390299:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492320000 00000100:00100000:3.0:1779690447.390339:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6416 00000100:00100000:3.0:1779690447.390347:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492320000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1779690447.390509:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:491 count 1 00002000:00010000:3.0:1779690447.390538:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1eb:0x0] initial LVB size: 1516, mtime: 0x6a13ebcb, atime: 0x0, ctime: 0x6a13ebcb, blocks: 0x1 00010000:00010000:3.0:1779690447.390766:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.390783:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690447.390785:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690447.390791:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.390925:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.390936:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.390943:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.390966:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690447.391118:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690447.391124:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.391133:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690447.391142:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.391152:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.391167:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.391173:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913ec25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.391191:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690447.391193:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690447.391194:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690447.392162:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1866137492320000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1814us (2051us total) trans 4294968343 rc 0/0 00000100:00100000:3.0:1779690447.392172:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6416 00000004:00080000:1.0:1779690447.392586:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e30bf4d5880/2, rc 0, transno 4294968343 00000100:00100000:1.0:1779690447.392593:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492320000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1779690447.393954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.393998:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647360 00000100:00100000:0.0:1779690447.394005:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647360 00000100:00100000:0.0:1779690447.394064:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6417 00000100:00100000:0.0:1779690447.394073:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503647360:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1779690447.429888:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968409 is committed 00000100:00100000:0.0:1779690447.431582:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503647360:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 37502us (37626us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.431594:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6417 00000100:00100000:2.0:1779690447.434590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.434909:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647616 00000100:00100000:1.0:1779690447.434919:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647616 00000100:00100000:1.0:1779690447.435864:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 581 00000100:00100000:1.0:1779690447.435876:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503647616:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690447.435933:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690447.435971:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913ec10 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedce0 expref: 41 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.436004:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:1.0:1779690447.436010:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690447.436048:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.436061:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.436070:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690447.436437:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4fcf120 reply state 00000000862d92ab transno 12884902161 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.436447:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690447.436544:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503647616:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 670us (1960us total) trans 12884902161 rc 0/0 00000100:00100000:1.0:1779690447.436551:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 581 00010000:00010000:3.0:1779690447.440605:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440623:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440630:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440636:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690447.440641:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440647:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440661:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:3.0:1779690447.440664:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690447.440668:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.440674:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec2c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690447.440692:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.440731:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647744 00000100:00100000:1.0:1779690447.440740:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647744 00000100:00100000:1.0:1779690447.440794:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 582 00000100:00100000:1.0:1779690447.440840:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503647744:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690447.440862:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690447.440877:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcf5 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.440938:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.440968:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.440985:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:1.0:1779690447.440988:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690447.440990:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9400, rc 0) 00000100:00100000:1.0:1779690447.441045:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503647744:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 244us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.441052:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 582 00000100:00100000:2.0:1779690447.443063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.443365:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503647872 00000100:00100000:3.0:1779690447.443373:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503647872 00000100:00100000:3.0:1779690447.443479:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6418 00000100:00100000:3.0:1779690447.443489:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503647872:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1779690447.443729:0:15940:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1eb:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690447.443733:0:15940:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1eb:0x0] updating lvb mtime from disk: 0 -> 1779690443 00002000:00010000:3.0:1779690447.443735:0:15940:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1eb:0x0] updating lvb atime from disk: 0 -> 1779690443 00002000:00010000:3.0:1779690447.443737:0:15940:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1eb:0x0] updating lvb ctime from disk: 0 -> 1779690443 00002000:00010000:3.0:1779690447.443740:0:15940:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1eb:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1779690447.443792:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503647872:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 305us (734us total) trans 4294968410 rc 0/0 00000100:00100000:3.0:1779690447.443799:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6418 00000100:00100000:3.0:1779690447.445459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690447.445561:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648128 00000100:00100000:2.0:1779690447.445568:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648128 00000100:00100000:2.0:1779690447.445636:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 583 00000100:00100000:2.0:1779690447.445645:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:103994:x1866137503648128:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1779690447.445699:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.445715:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.445741:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.445774:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690447.445787:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 42 pid: 57559 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690447.445800:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492320128:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690447.445915:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f96cf7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690447.448116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.448194:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648256 00000100:00100000:1.0:1779690447.448201:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648256 00010000:00010000:1.0:1779690447.448230:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 43 pid: 57559 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.448263:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3242 00000100:00100000:1.0:1779690447.448281:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+43:2391:x1866137503648256:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690447.448293:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690447.448299:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 43 pid: 57559 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.448311:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 43 pid: 57559 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.448331:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:1.0:1779690447.448335:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.448355:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.448362:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.448379:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690447.448424:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+43:2391:x1866137503648256:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 153us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.448435:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3242 00010000:00010000:0.0:1779690447.448528:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913ebdf lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedccb expref: 42 pid: 57559 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.448544:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492320128:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690447.448566:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448575:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448580:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448606:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448613:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448619:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448625:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.448629:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448636:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448644:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:0.0:1779690447.448647:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1779690447.448651:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.448657:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913ec3a lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.448717:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503648128:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 3072us (3261us total) trans 0 rc -22/-22 00000100:00100000:0.0:1779690447.448725:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 583 00000100:00100000:2.0:1779690447.451154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.451783:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648384 00000100:00100000:0.0:1779690447.451793:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648384 00000100:00100000:0.0:1779690447.451870:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6419 00000100:00100000:0.0:1779690447.451880:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503648384:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.451920:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.451940:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.451948:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690447.451950:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690447.451954:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.451986:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.452000:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 12 pid: 6581 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.452015:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492320256:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690447.452127:0:22747:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3086034b40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690447.455437:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492320256:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690447.455464:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690447.456688:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.457038:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648512 00000100:00100000:1.0:1779690447.457046:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648512 00010000:00010000:1.0:1779690447.457081:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 13 pid: 6581 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.457126:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3243 00000100:00100000:1.0:1779690447.457140:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503648512:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690447.457152:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690447.457172:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 13 pid: 6581 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.457184:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 13 pid: 6581 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.457207:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ab09e0a/0xb4bb873a1913ec1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcee expref: 13 pid: 6581 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.457236:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.457238:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.457243:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.457253:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.457295:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690447.457351:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503648512:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 213us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.457359:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3243 00010000:00010000:0.0:1779690447.457456:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457466:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457489:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457498:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457505:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457511:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690447.457514:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457523:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457548:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.457555:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913ec41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.457599:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503648384:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 5721us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690447.457607:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6419 00000100:00100000:1.0:1779690447.460516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.460617:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648768 00000100:00100000:0.0:1779690447.460625:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648768 00000100:00100000:0.0:1779690447.460729:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 584 00000100:00100000:0.0:1779690447.460740:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:103994:x1866137503648768:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1779690447.460846:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.460864:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.460875:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.461475:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.461487:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.461506:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.461535:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.461546:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.461560:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492320384:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690447.461690:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3086034b40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690447.463906:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.463974:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503648896 00000100:00100000:1.0:1779690447.463981:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503648896 00010000:00010000:1.0:1779690447.464008:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 43 pid: 57585 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.464029:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3244 00000100:00100000:1.0:1779690447.464034:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+43:2392:x1866137503648896:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690447.464045:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690447.464048:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 43 pid: 57585 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.464057:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 43 pid: 57585 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.464087:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:1.0:1779690447.464092:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.464100:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.464107:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.464124:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690447.464167:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+43:2392:x1866137503648896:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 131us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.464175:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3244 00010000:00010000:0.0:1779690447.464258:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec33 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcf5 expref: 42 pid: 57585 timeout: 3275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.464281:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492320384:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690447.464298:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.464303:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.464307:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690447.464630:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902162 00000001:00080000:0.0:1779690447.465193:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902163 00000001:00080000:0.0:1779690447.465365:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902164 00000100:00100000:0.0:1779690447.465464:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:57561:1866137492320512:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1779690447.465512:0:57561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690447.465543:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81e65780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690447.465753:0:40938:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492320512 00000100:00100000:1.0:1779690447.465758:0:40938:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492320512 00000100:00100000:1.0:1779690447.465831:0:40938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:1.0:1779690447.465840:0:40938:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57561:x1866137492320512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1779690447.465899:0:40938:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57561:x1866137492320512:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.465906:0:40938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00080000:3.0:1779690447.465960:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690447.466430:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:57561:1866137492320512:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1779690447.467223:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902165 00000100:00100000:0.0:1779690447.467296:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:57561:1866137492320640:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1779690447.467332:0:57561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690447.467401:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81e653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690447.467474:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492320640 00000100:00100000:1.0:1779690447.467481:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492320640 00000100:00100000:1.0:1779690447.467550:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:1.0:1779690447.467558:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57561:x1866137492320640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1779690447.467729:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57561:x1866137492320640:12345-0@lo:1000:mdt00_002.0 Request processed in 172us (395us total) trans 4294968411 rc 0/0 00000100:00100000:1.0:1779690447.467745:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:0.0:1779690447.467801:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:57561:1866137492320640:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1779690447.467909:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902166 00010000:00010000:0.0:1779690447.467937:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.467947:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.467954:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.467960:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.467964:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.467970:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.467984:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f905ad200) 00010000:00010000:0.0:1779690447.467987:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690447.467991:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468003:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913ec4f lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690447.468194:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902167 00010000:00010000:0.0:1779690447.468222:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468228:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468233:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468237:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.468240:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468245:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468253:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00010000:00010000:0.0:1779690447.468255:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690447.468261:0:57561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468281:0:57561:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468290:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.468326:0:57561:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c5600/0xb4bb873a1913eb84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcb6 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690447.468337:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492320768:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690447.468409:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81e653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690447.470309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.470386:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492320768:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690447.470404:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470410:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913eb7d lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470433:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470444:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470454:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470464:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470471:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470477:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470503:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.470507:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470514:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.470520:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649024 00010000:00010000:0.0:1779690447.470524:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00000100:00100000:1.0:1779690447.470526:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649024 00010000:00010000:0.0:1779690447.470526:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690447.470530:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470535:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913ec56 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470545:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470550:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470555:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470560:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690447.470562:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470568:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.470578:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00010000:00010000:0.0:1779690447.470585:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x19:0x0].0x0 (ffff9e2f903c9b00) 00000100:00100000:1.0:1779690447.470586:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+41:103993:x1866137503649024:12345-192.168.203.5@tcp:49:md5sum.0 00010000:00010000:0.0:1779690447.470587:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690447.470590:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690447.470595:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ec48 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690447.470703:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+41:103993:x1866137503649024:12345-192.168.203.5@tcp:49:md5sum.0 Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.470710:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:0.0:1779690447.470756:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:103994:x1866137503648768:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 10019us (10247us total) trans 12884902168 rc 0/0 00000100:00100000:0.0:1779690447.470764:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 584 00000040:00080000:1.0:1779690447.470839:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690447.470843:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000020:00080000:0.0:1779690447.471408:0:57561:0:(tgt_main.c:783:tgt_ses_key_exit()) total 7 transactions per RPC 00000040:00080000:1.0:1779690447.471601:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:1.0:1779690447.471609:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690447.472633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690447.472870:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649280 00000100:00100000:1.0:1779690447.472878:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649280 00000100:00100000:1.0:1779690447.472961:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1779690447.472971:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+47:103994:x1866137503649280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1779690447.473709:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1779690447.473862:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902169 00010000:00010000:1.0:1779690447.473909:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473924:0:57563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473936:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473943:0:57563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473958:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473965:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.473991:0:57563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1779690447.474067:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+49:103994:x1866137503649280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1097us (1435us total) trans 12884902170 rc 0/0 00000100:00100000:1.0:1779690447.474074:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000020:00080000:1.0:1779690447.474079:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690447.474169:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690447.474176:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.474183:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690447.474332:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.474340:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.474352:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1a:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:3.0:1779690447.474355:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690447.474359:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690447.474365:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec5d lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690447.474425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690447.474448:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690447.474450:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690447.474452:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690447.474663:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649408 00000100:00100000:1.0:1779690447.474669:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649408 00000100:00100000:1.0:1779690447.474744:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6420 00000100:00100000:1.0:1779690447.474753:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+15:103993:x1866137503649408:12345-192.168.203.5@tcp:101:md5sum.0 00010000:00010000:1.0:1779690447.474765:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690447.474779:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913ec64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedcfc expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690447.474801:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1eb:0x0] initial LVB size: 1516, mtime: 0x6a13ebcb, atime: 0x6a13ebcb, ctime: 0x6a13ebcb, blocks: 0xb 00010000:00010000:1.0:1779690447.474845:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.474847:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690447.474856:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913ec64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcfc expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.474870:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913ec64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcfc expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690447.474891:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690447.474924:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+16:103993:x1866137503649408:12345-192.168.203.5@tcp:101:md5sum.0 Request processed in 172us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690447.474931:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6420 00000100:00100000:2.0:1779690447.478588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690447.478666:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649536 00000100:00100000:0.0:1779690447.478675:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649536 00002000:00100000:0.0:1779690447.478732:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1eb:0x0] (0->4095) req@ffff9e2f95b5e300 x1866137503649536/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:683/0 lens 488/0 e 0 to 0 dl 1779690458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690447.478744:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95b5e300 with x1866137503649536 ext(0->4095) 00002000:00010000:0.0:1779690447.478749:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f95b5e300 00000100:00100000:0.0:1779690447.478782:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2048 00000100:00100000:0.0:1779690447.478792:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503649536:12345-192.168.203.5@tcp:3:md5sum.0 00000100:00100000:0.0:1779690447.479055:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e775ff0e-5641-488a-99d7-1331a4992115+16:2392:x1866137503649536:12345-192.168.203.5@tcp:3:md5sum.0 Request processed in 263us (477us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1779690447.479062:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2048 00002000:00100000:0.0:1779690447.479069:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1eb:0x0] (0->4095) req@ffff9e2f95b5e300 x1866137503649536/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:683/0 lens 488/4536 e 0 to 0 dl 1779690458 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690447.479093:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95b5e300 with x1866137503649536 ext(0->4095) 00002000:00010000:0.0:1779690447.479097:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f95b5e300 00000100:00100000:2.0:1779690447.485955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690447.486037:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649792 00000100:00100000:3.0:1779690447.486046:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649792 00000100:00100000:3.0:1779690447.486099:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1779690447.486117:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+41:103993:x1866137503649792:12345-192.168.203.5@tcp:35:md5sum.0 00000100:00100000:3.0:1779690447.486501:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+42:103993:x1866137503649792:12345-192.168.203.5@tcp:35:md5sum.0 Request processed in 384us (552us total) trans 12884902171 rc 0/0 00000100:00100000:3.0:1779690447.486509:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000040:00080000:1.0:1779690448.086951:0:66306:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690448.086960:0:66306:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690448.087031:0:66306:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 27 count 11 00000040:00080000:1.0:1779690448.087038:0:66306:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690448.142396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690448.142498:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503649920 00000100:00100000:0.0:1779690448.142508:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503649920 00000100:00100000:0.0:1779690448.142583:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 585 00000100:00100000:0.0:1779690448.142595:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503649920:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690448.142760:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503649920:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690448.142768:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 585 00000100:00080000:2.0:1779690448.142844:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690448.145385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690448.145450:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650048 00000100:00100000:3.0:1779690448.145459:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650048 00000100:00100000:3.0:1779690448.145508:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 586 00000100:00100000:3.0:1779690448.145518:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650048:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1779690448.145660:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690448.145729:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650048:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 212us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690448.145737:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 586 00000100:00100000:2.0:1779690448.156275:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690448.157383:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650176 00000100:00100000:0.0:1779690448.157394:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650176 00000100:00100000:0.0:1779690448.157450:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 587 00000100:00100000:0.0:1779690448.157460:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650176:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690448.157733:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690448.157846:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650176:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 387us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690448.157854:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 587 00000100:00100000:2.0:1779690448.161780:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690448.161895:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650304 00000100:00100000:0.0:1779690448.161904:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650304 00000100:00100000:0.0:1779690448.161951:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 588 00000100:00100000:0.0:1779690448.161961:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650304:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690448.162107:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690448.162181:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650304:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 222us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690448.162198:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 588 00000100:00100000:2.0:1779690448.169611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690448.170119:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650432 00000100:00100000:3.0:1779690448.170130:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650432 00000100:00100000:3.0:1779690448.170221:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 589 00000100:00100000:3.0:1779690448.170232:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650432:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690448.170449:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650432:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 218us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690448.170458:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 589 00000100:00100000:2.0:1779690448.172385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690448.175332:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650560 00000100:00100000:3.0:1779690448.175345:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650560 00000100:00100000:3.0:1779690448.175414:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 590 00000100:00100000:3.0:1779690448.175424:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650560:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690448.175585:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650560:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 163us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690448.175593:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 590 00000100:00100000:2.0:1779690448.182902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690448.182939:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650688 00000100:00100000:2.0:1779690448.182948:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650688 00000100:00100000:2.0:1779690448.182997:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 591 00000100:00100000:2.0:1779690448.183008:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650688:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690448.183528:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650688:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 522us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.183537:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 591 00000100:00100000:2.0:1779690448.188896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690448.188934:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650816 00000100:00100000:2.0:1779690448.188943:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650816 00000100:00100000:2.0:1779690448.188998:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 592 00000100:00100000:2.0:1779690448.189011:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690448.189326:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:104009:x1866137503650816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 316us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.189334:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 592 00010000:00010000:3.0:1779690448.328986:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690448.842539:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690448.842562:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492320896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690448.842632:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690448.842786:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492320896 00000100:00100000:2.0:1779690448.842795:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492320896 00000100:00100000:2.0:1779690448.842872:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1779690448.842882:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1866137492320896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690448.842914:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 744292352 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690448.842959:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1866137492320896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.842967:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1779690448.843117:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492321024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690448.843147:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690448.843189:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321024 00000100:00100000:1.0:1779690448.843192:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321024 00000100:00100000:1.0:1779690448.843217:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1779690448.843223:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492321024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690448.843242:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690448.843287:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492321024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690448.843293:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1779690448.843334:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492321024:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1779690448.843376:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690448.843402:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492320896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690448.843552:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492321408:0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.843582:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690448.843612:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690448.843619:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492321280:0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.843641:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690448.843668:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321408 00000100:00100000:2.0:1779690448.843671:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321408 00000100:00100000:2.0:1779690448.843701:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321280 00000100:00100000:2.0:1779690448.843703:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321280 00000100:00100000:2.0:1779690448.843734:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1779690448.843740:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492321408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.843773:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492321408:12345-0@lo:400:kworker.0 Request processed in 33us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.843779:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1779690448.843790:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1779690448.843795:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492321280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.843839:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492321280:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.843845:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1779690448.843869:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492321280:0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.843878:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492321408:0@lo:400:kworker.0 00000100:00100000:1.0:1779690448.845521:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492321536:0@lo:400:kworker.0 00000100:00100000:1.0:1779690448.845573:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690448.845631:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690448.845639:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492321152:0@lo:400:kworker.0 00000100:00100000:1.0:1779690448.845669:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690448.845744:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321152 00000100:00100000:1.0:1779690448.845750:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321152 00000100:00100000:1.0:1779690448.845787:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1779690448.845794:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492321152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690448.845872:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492321152:12345-0@lo:400:kworker.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690448.845879:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1779690448.845921:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492321152:0@lo:400:kworker.0 00000100:00080000:0.0:1779690448.847551:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690448.847917:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321536 00000100:00100000:2.0:1779690448.847927:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321536 00000100:00100000:2.0:1779690448.847977:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1779690448.847986:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492321536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690448.848070:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492321536:12345-0@lo:400:kworker.0 Request processed in 85us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690448.848077:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1779690448.848906:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492321536:0@lo:400:kworker.0 00010000:00010000:2.0:1779690449.353037:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690450.377042:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690450.922675:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968341 is committed 00000001:00080000:1.0:1779690450.922963:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968342 is committed 00000001:00080000:1.0:1779690450.923033:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968343 is committed 00000100:00100000:2.0:1779690451.393578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.393655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.393695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.393721:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.393741:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.393761:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690451.393844:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651328 00000100:00100000:1.0:1779690451.393854:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651328 00000100:00100000:1.0:1779690451.393909:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651584 00000100:00100000:1.0:1779690451.393913:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651584 00000100:00100000:1.0:1779690451.393933:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651200 00000100:00100000:1.0:1779690451.393936:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651200 00000100:00100000:1.0:1779690451.393958:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2850 00000100:00100000:1.0:1779690451.393968:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503651328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690451.394039:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503651328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690451.394046:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2850 00000100:00100000:1.0:1779690451.394060:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2851 00000100:00100000:1.0:1779690451.394067:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503651584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690451.394089:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503651584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690451.394101:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2851 00000100:00100000:1.0:1779690451.394126:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2852 00000100:00100000:1.0:1779690451.394133:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503651200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690451.394155:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503651200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690451.394161:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2852 00000100:00080000:1.0:1779690451.394175:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690451.394178:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690451.395380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690451.395410:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651712 00000100:00100000:2.0:1779690451.395416:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651712 00000100:00100000:2.0:1779690451.395456:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2853 00000100:00100000:2.0:1779690451.395463:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503651712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690451.395507:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503651712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00080000:1.0:1779690451.395522:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690451.395524:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2853 00000100:00100000:2.0:1779690451.395545:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503650944 00000100:00100000:2.0:1779690451.395548:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503650944 00000100:00100000:2.0:1779690451.395580:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:2.0:1779690451.395586:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503650944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690451.395609:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503650944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690451.395614:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:0.0:1779690451.396508:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651072 00000100:00100000:0.0:1779690451.396577:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651072 00000100:00100000:0.0:1779690451.396627:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651456 00000100:00100000:0.0:1779690451.396630:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651456 00000100:00100000:0.0:1779690451.396653:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:0.0:1779690451.396660:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:2390:x1866137503651072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690451.396760:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+49:2390:x1866137503651072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690451.396766:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:0.0:1779690451.396782:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:0.0:1779690451.396788:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+42:2390:x1866137503651456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690451.396904:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+42:2390:x1866137503651456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 116us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690451.396910:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00080000:2.0:1779690451.397074:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690451.401006:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690452.429325:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690452.449146:0:66505:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690452.449151:0:66505:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690452.449191:0:66505:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 6 count 2 00000040:00080000:2.0:1779690452.449197:0:66505:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000001:00080000:0.0:1779690452.475048:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968411 is committed 00000001:00080000:0.0:1779690452.475064:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968410 is committed 00000001:00080000:1.0:1779690452.477120:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902168 is committed 00000020:00080000:1.0:1779690452.477136:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f81e65240 refcount 2 committed 0 result 0 batchid 8590018966 00000020:00080000:1.0:1779690452.477142:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e2f8899f500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f81e65780 00000020:00080000:1.0:1779690452.477146:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e2f8899fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f81a3d000 00000001:00080000:1.0:1779690452.477166:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902170 is committed 00000020:00080000:1.0:1779690452.477178:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018965 batchid updated 00000001:00080000:1.0:1779690452.477183:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902171 is committed 00000020:00080000:1.0:1779690452.477196:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018966 committed batchid 8590018965 00000020:00080000:1.0:1779690452.477395:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018965 00000100:00100000:2.0:1779690452.503750:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690452.503967:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651840 00000100:00100000:0.0:1779690452.503977:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651840 00000100:00100000:0.0:1779690452.504040:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 593 00000100:00100000:0.0:1779690452.504049:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:104454:x1866137503651840:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690452.504088:0:57559:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b39a3d88 uarg=0000000000000000 00000004:00000080:0.0:1779690452.504124:0:57559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b39a3d88 00000004:00000080:0.0:1779690452.504129:0:57559:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=5, endrec=0 00000040:00080000:0.0:1779690452.504211:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690452.504215:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690452.504264:0:57559:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl5 endrec = 20 00000040:00080000:0.0:1779690452.504351:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 6 count 2 00000040:00080000:0.0:1779690452.504358:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690452.504363:0:57559:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl5 entries up to 18446744073709551615 00000040:00080000:0.0:1779690452.504396:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690452.504399:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690452.505448:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 20 count 1 00000040:00080000:0.0:1779690452.505456:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690452.505556:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:104454:x1866137503651840:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1504us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690452.505567:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 593 00000020:00000080:1.0:1779690453.106412:0:66555:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fff20d71f50 00000004:00000080:1.0:1779690453.106431:0:66555:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e308702bc00 uarg=0000000000000000 00000004:00000080:1.0:1779690453.106475:0:66555:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e308702bc00 00000004:00000080:1.0:1779690453.106481:0:66555:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=5, endrec=0 00000040:00080000:1.0:1779690453.106590:0:66555:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690453.106594:0:66555:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690453.106625:0:66555:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl5 endrec = 20 00000040:00080000:1.0:1779690453.106696:0:66555:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 6 count 2 00000040:00080000:1.0:1779690453.106703:0:66555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690453.106735:0:66555:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl5 entries up to 18446744073709551615 00000040:00080000:1.0:1779690453.106775:0:66555:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690453.106778:0:66555:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690453.107375:0:66555:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690453.107383:0:66555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:1.0:1779690453.107403:0:66555:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=5 00000040:00080000:1.0:1779690453.107447:0:66555:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690453.107450:0:66555:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690453.107648:0:66555:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 5 count 1 00000040:00080000:1.0:1779690453.107653:0:66555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690453.107670:0:66555:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1779690453.107671:0:66555:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1779690453.119581:0:66555:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl5 record=18446744073709551615 00000040:00080000:2.0:1779690453.119960:0:66555:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690453.119965:0:66555:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690453.120534:0:66555:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690453.120542:0:66555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1779690453.121065:0:66555:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690453.121069:0:66555:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690453.125327:0:66555:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690453.125345:0:66555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690453.449304:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690453.641132:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690453.641144:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690453.644676:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 27 count 9 00000040:00080000:1.0:1779690453.644927:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690453.851691:0:66603:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690453.851714:0:66603:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690453.852262:0:66603:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690453.852276:0:66603:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1779690453.959228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690453.959902:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503651968 00000100:00100000:2.0:1779690453.959913:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503651968 00000100:00100000:2.0:1779690453.959985:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 594 00000100:00100000:2.0:1779690453.959994:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:103936:x1866137503651968:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1779690453.960086:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:103936:x1866137503651968:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 93us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690453.960094:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 594 00000100:00080000:3.0:1779690453.962077:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690453.962915:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492321664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690453.962977:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690453.963125:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492321792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690453.963155:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690453.963198:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321664 00000100:00100000:3.0:1779690453.963217:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321664 00000100:00100000:3.0:1779690453.963530:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321792 00000100:00100000:3.0:1779690453.963535:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321792 00000100:00100000:3.0:1779690453.963555:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1779690453.963563:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492321664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690453.963594:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742588416 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690453.963640:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492321664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690453.963646:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1779690453.963664:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1779690453.963669:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492321792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690453.963684:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690453.963719:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492321792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690453.963724:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00080000:3.0:1779690453.963743:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690453.963747:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690453.963770:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968411 gen 2 00000004:00080000:3.0:1779690453.963775:0:3318:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968411 committed transno 4294968411 00000100:00100000:3.0:1779690453.963800:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492321792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690453.963845:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968343 gen 2 00000004:00080000:3.0:1779690453.963849:0:3321:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968342 committed transno 4294968343 00000004:00080000:3.0:1779690453.963859:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e30bf4d5880, transno 4294968343 00000100:00100000:3.0:1779690453.963872:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492321664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690453.964303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690453.964324:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503652224 00000100:00100000:3.0:1779690453.964328:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503652224 00000100:00100000:3.0:1779690453.964349:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:3.0:1779690453.964355:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+39:103936:x1866137503652224:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690453.964634:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+40:103936:x1866137503652224:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 278us (332us total) trans 12884902172 rc 0/0 00000100:00100000:3.0:1779690453.964641:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:1.0:1779690453.965473:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492322048:0@lo:400:kworker.0 00000100:00100000:1.0:1779690453.965513:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690453.965556:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690453.965562:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492322176:0@lo:400:kworker.0 00000100:00100000:1.0:1779690453.965584:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690453.965612:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492322048 00000100:00100000:1.0:1779690453.965616:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492322048 00000100:00100000:1.0:1779690453.965653:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492322176 00000100:00100000:1.0:1779690453.965656:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492322176 00000100:00100000:1.0:1779690453.965700:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1779690453.965707:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690453.965747:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492322048:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690453.965753:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1779690453.965766:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1779690453.965772:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492322176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690453.965798:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492322176:12345-0@lo:400:kworker.0 Request processed in 26us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690453.965827:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1779690453.965848:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690453.965869:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492322176:0@lo:400:kworker.0 00000100:00100000:1.0:1779690453.965877:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492322048:0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.965942:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492321920:0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.965977:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690453.966002:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690453.966007:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492322304:0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.966028:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690453.966051:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492321920 00000100:00100000:2.0:1779690453.966055:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492321920 00000100:00100000:2.0:1779690453.966079:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1779690453.966085:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492321920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.966113:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492321920:12345-0@lo:400:kworker.0 Request processed in 28us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690453.966124:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1779690453.966151:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492322304 00000100:00100000:2.0:1779690453.966154:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492322304 00000100:00100000:2.0:1779690453.966174:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1779690453.966179:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492322304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.966218:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492322304:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690453.966224:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1779690453.966248:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492322304:0@lo:400:kworker.0 00000100:00100000:2.0:1779690453.966256:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492321920:0@lo:400:kworker.0 00010000:00010000:3.0:1779690454.473049:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1779690455.258342:0:66651:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 02:27:34 (1779690454) 00000100:00100000:2.0:1779690455.477332:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.477403:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503652480 00000100:00100000:1.0:1779690455.477412:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503652480 00000100:00100000:1.0:1779690455.477476:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 595 00000100:00100000:1.0:1779690455.477485:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104656:x1866137503652480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690455.477505:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690455.477524:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd03 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477594:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477607:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477635:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477647:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477654:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.477660:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1779690455.477950:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690455.478510:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ec80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478532:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ec80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478540:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ec80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690455.478601:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690455.478729:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478736:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478742:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478747:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690455.478750:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478757:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478768:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690455.478771:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690455.478776:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478782:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913ec72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478794:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478936:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478942:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478948:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690455.478951:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478957:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478964:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f903c9200) 00010000:00010000:0.0:1779690455.478967:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690455.478970:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.478974:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ec79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.479686:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ec6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd03 expref: 43 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.479704:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ec80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd03 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.479712:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690455.479714:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690455.479723:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f000, rc 0) 00000100:00100000:0.0:1779690455.479836:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+42:104656:x1866137503652480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2317us (2477us total) trans 12884902173 rc 0/0 00000100:00100000:0.0:1779690455.479846:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 595 00000100:00100000:3.0:1779690455.483065:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.483268:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503652608 00000100:00100000:2.0:1779690455.483282:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503652608 00000100:00100000:2.0:1779690455.483365:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 596 00000100:00100000:2.0:1779690455.483378:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+42:104656:x1866137503652608:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690455.483532:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+42:104656:x1866137503652608:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 157us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690455.483541:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 596 00000100:00100000:3.0:1779690455.483878:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.484744:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503652736 00000100:00100000:2.0:1779690455.484754:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503652736 00000100:00100000:2.0:1779690455.485072:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18662 00000100:00100000:2.0:1779690455.485084:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+42:2392:x1866137503652736:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690455.485101:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690455.485134:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913ec80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd03 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.485176:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690455.485183:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690455.485260:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+41:2392:x1866137503652736:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 179us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690455.485268:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18662 00000100:00100000:3.0:1779690455.490792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.491061:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503652864 00000100:00100000:2.0:1779690455.491076:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503652864 00000100:00100000:2.0:1779690455.491212:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 597 00000100:00100000:2.0:1779690455.491235:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+41:104657:x1866137503652864:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690455.491262:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690455.491288:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ec8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd0a expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491373:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491390:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491406:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491423:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491431:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491479:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491858:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491868:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491875:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491882:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.491889:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491898:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491913:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:2.0:1779690455.491916:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.491921:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491927:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ec95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491941:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491947:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491960:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491966:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.491968:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491975:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491983:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690455.491986:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.491989:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.491995:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ec9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.492033:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ec8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd0a expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.492044:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:2.0:1779690455.492046:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.492050:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ec8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd0a expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.492060:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c800, rc 0) 00000100:00100000:2.0:1779690455.492136:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+41:104657:x1866137503652864:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 914us (1360us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690455.492154:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 597 00000100:00080000:3.0:1779690455.494612:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690455.497047:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690455.500745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690455.500838:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653120 00000100:00100000:0.0:1779690455.500852:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653120 00000100:00100000:0.0:1779690455.500927:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 598 00000100:00100000:0.0:1779690455.500940:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+41:104657:x1866137503653120:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690455.501017:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690455.501049:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913e9d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc1c expref: 41 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.501071:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:0.0:1779690455.501077:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690455.501439:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.501456:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.501466:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.501507:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 40 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.501523:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 40 pid: 64445 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690455.501556:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492322432:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690455.502046:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f96d5d180 going to sleep for 11 seconds 00000100:00100000:2.0:1779690455.505538:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492322432:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690455.505579:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690455.506087:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.506756:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653248 00000100:00100000:1.0:1779690455.506767:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653248 00010000:00010000:1.0:1779690455.506849:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 41 pid: 64445 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690455.506891:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3245 00000100:00100000:1.0:1779690455.506912:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+41:2391:x1866137503653248:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690455.506932:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690455.506941:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 41 pid: 64445 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.506956:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 41 pid: 64445 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.506984:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf4c4000/0xb4bb873a1913ea11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedc31 expref: 41 pid: 64445 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.507024:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:1.0:1779690455.507030:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.507041:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.507050:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.507081:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690455.507119:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.507129:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690455.507158:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+40:2391:x1866137503653248:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 248us (1072us total) trans 0 rc 0/0 00010000:00010000:0.0:1779690455.507160:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690455.507175:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3245 00010000:00010000:0.0:1779690455.507175:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.507197:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690455.508481:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81:0x0]: returning size 512 00010000:00010000:0.0:1779690455.508496:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508506:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508513:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508519:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690455.508525:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508540:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508554:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f883cb000) 00010000:00010000:0.0:1779690455.508557:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690455.508562:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.508567:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eca3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690455.508586:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000af35a2a5 reply state 000000008a2d5e93 transno 12884902174 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690455.508595:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690455.508705:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+42:104657:x1866137503653120:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 7766us (7971us total) trans 12884902174 rc 0/0 00000100:00100000:0.0:1779690455.508715:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 598 00010000:00010000:1.0:1779690455.510992:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511013:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511021:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511027:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690455.511032:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511040:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511079:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690455.511083:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690455.511089:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.511107:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ecaa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1779690455.689792:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690455.689887:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690455.690408:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:1.0:1779690455.690420:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690455.793074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.793251:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653376 00000100:00100000:1.0:1779690455.793264:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653376 00000100:00100000:1.0:1779690455.793358:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 599 00000100:00100000:1.0:1779690455.793371:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+41:104694:x1866137503653376:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690455.793406:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690455.793437:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ecb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd11 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793524:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793542:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793557:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690455.793670:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690455.793675:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 105 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690455.793712:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793741:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ecb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd11 expref: 43 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793763:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd11 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.793783:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690455.793786:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690455.793790:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8000, rc 0) 00000100:00100000:1.0:1779690455.793926:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+42:104694:x1866137503653376:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 558us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690455.793934:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 599 00000100:00100000:1.0:1779690455.799879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.799930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690455.800028:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653504 00000100:00100000:3.0:1779690455.800041:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653504 00000100:00100000:3.0:1779690455.800104:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653760 00000100:00100000:3.0:1779690455.800106:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653760 00000100:00100000:3.0:1779690455.800131:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 600 00000100:00100000:3.0:1779690455.800142:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+43:2390:x1866137503653504:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:3.0:1779690455.800209:0:57561:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257977344 avail 2255880192 00000100:00100000:3.0:1779690455.800290:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+43:2390:x1866137503653504:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690455.800298:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 600 00000100:00100000:3.0:1779690455.800318:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 601 00000100:00100000:3.0:1779690455.800323:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+42:104694:x1866137503653760:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:3.0:1779690455.800381:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690455.800414:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913ecb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd11 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.800437:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690455.800449:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690455.800594:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+41:104694:x1866137503653760:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 270us (662us total) trans 0 rc -17/-17 00000100:00100000:3.0:1779690455.800600:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 601 00000100:00100000:0.0:1779690455.803580:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.803702:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503653888 00000100:00100000:1.0:1779690455.803716:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503653888 00000100:00100000:1.0:1779690455.803788:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 602 00000100:00100000:1.0:1779690455.803799:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+41:104694:x1866137503653888:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690455.803852:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690455.803883:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ecbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd18 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.803992:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.804008:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.804021:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690455.804098:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690455.804101:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 105 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690455.804130:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.804156:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ecbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd18 expref: 43 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.804176:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd18 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.804196:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690455.804199:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690455.804203:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9400, rc 0) 00000100:00100000:1.0:1779690455.804277:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+42:104694:x1866137503653888:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 480us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690455.804285:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 602 00000100:00100000:3.0:1779690455.807221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.807336:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503654016 00000100:00100000:2.0:1779690455.807349:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503654016 00000100:00100000:2.0:1779690455.807417:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 603 00000100:00100000:2.0:1779690455.807429:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+42:104694:x1866137503654016:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690455.807456:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690455.807482:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913eccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd1f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807563:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807580:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807593:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807611:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807618:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807657:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807797:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807837:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807846:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690455.807895:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81:0x0]: returning size 512 00000004:00200000:2.0:1779690455.807899:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690455.807926:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807939:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807946:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807954:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807960:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.807966:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807974:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.807996:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690455.807999:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.808005:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808011:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913ecd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808027:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808033:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808039:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808044:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.808048:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808054:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808061:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690455.808063:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.808065:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808070:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ecdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808115:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913eccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd1f expref: 44 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808129:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd1f expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.808137:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:2.0:1779690455.808139:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690455.808142:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c000, rc 0) 00000100:00100000:2.0:1779690455.808231:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+43:104694:x1866137503654016:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 801us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690455.808240:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 603 00000100:00100000:2.0:1779690455.849376:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690455.849612:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503654144 00000100:00100000:0.0:1779690455.849627:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503654144 00000100:00100000:0.0:1779690455.849790:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 604 00000100:00100000:0.0:1779690455.849822:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104700:x1866137503654144:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690455.849850:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690455.849875:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ece9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd26 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.849955:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.849989:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.850002:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690455.850084:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690455.850089:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 105 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690455.850130:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.850158:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ece9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.850197:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.850208:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:0.0:1779690455.850211:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690455.850216:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ec00, rc 0) 00000100:00100000:0.0:1779690455.850301:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:104700:x1866137503654144:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 502us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690455.850308:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 604 00000100:00100000:0.0:1779690455.858129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690455.858257:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503654400 00000100:00100000:3.0:1779690455.858271:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503654400 00000100:00100000:3.0:1779690455.858749:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 605 00000100:00100000:3.0:1779690455.858779:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+43:104700:x1866137503654400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690455.858845:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690455.858849:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690455.858886:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ece2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd1f expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.858911:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ecd00) 00010000:00010000:3.0:1779690455.858925:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690455.858945:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913ecf7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd2d expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859121:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859138:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859150:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859163:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859169:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.859176:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860457:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860479:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860489:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690455.860502:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x83:0x0]: returning size 0 00010000:00010000:3.0:1779690455.860532:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860538:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860545:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860550:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690455.860554:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860562:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860584:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:3.0:1779690455.860587:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690455.860592:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860598:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ecfe lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690455.860621:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000b3a1638 reply state 000000005cacb87b transno 12884902175 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690455.860630:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690455.860677:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913ecf7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860695:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.860702:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690455.860705:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690455.860707:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266800, rc 0) 00000100:00100000:3.0:1779690455.860800:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+45:104700:x1866137503654400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2024us (2684us total) trans 12884902175 rc 0/0 00000100:00100000:3.0:1779690455.860849:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 605 00010000:00010000:2.0:1779690455.866839:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866862:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866872:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866878:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.866883:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866892:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866953:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0xe3b444b9 (ffff9e2f905ad100) 00010000:00010000:2.0:1779690455.866957:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.866964:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.866971:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913ed05 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690455.867725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.868021:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503654656 00000100:00100000:1.0:1779690455.868035:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503654656 00000100:00100000:1.0:1779690455.868154:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 606 00000100:00100000:1.0:1779690455.868166:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:104700:x1866137503654656:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690455.868207:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690455.868244:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ed1a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd34 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.868363:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.868380:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.868390:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.868632:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690455.868649:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 45 pid: 57561 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690455.868666:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492322560:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690455.868919:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f942bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1779690455.871417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690455.871472:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503654784 00000100:00100000:3.0:1779690455.871483:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503654784 00010000:00010000:3.0:1779690455.871530:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 46 pid: 57561 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690455.871630:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3246 00000100:00100000:3.0:1779690455.871641:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+46:2391:x1866137503654784:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690455.871660:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690455.871677:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 46 pid: 57561 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.871716:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 46 pid: 57561 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.871745:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690455.871751:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.871831:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.871841:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.871865:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690455.872432:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+46:2391:x1866137503654784:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 790us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690455.872442:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3246 00010000:00010000:1.0:1779690455.873115:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913ed0c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd2d expref: 45 pid: 57561 timeout: 3283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690455.873138:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492322560:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690455.873166:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.873376:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.873384:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690455.873418:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x83:0x0]: returning size 0 00010000:00010000:0.0:1779690455.874110:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874120:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874127:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874133:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690455.874137:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874145:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874161:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:0.0:1779690455.874164:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690455.874170:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874175:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ed21 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874532:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ed1a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd34 expref: 45 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874542:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690455.874544:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690455.874554:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ed1a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd34 expref: 45 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.874568:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:0.0:1779690455.874702:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:104700:x1866137503654656:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6537us (6985us total) trans 12884902176 rc 301/301 00000100:00100000:0.0:1779690455.874712:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 606 00000100:00100000:2.0:1779690455.877586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690455.877916:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503655040 00000100:00100000:3.0:1779690455.877929:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503655040 00000100:00100000:3.0:1779690455.878040:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:3.0:1779690455.878053:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f90559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+44:104700:x1866137503655040:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690455.878724:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f90559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+45:104700:x1866137503655040:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 671us (1149us total) trans 12884902177 rc 0/0 00000100:00100000:3.0:1779690455.878735:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1779690455.881357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690455.881596:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503655168 00000100:00100000:0.0:1779690455.881608:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503655168 00000100:00100000:0.0:1779690455.881679:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 607 00000100:00100000:0.0:1779690455.881691:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+45:104700:x1866137503655168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690455.881734:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690455.881762:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ed2f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd3b expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.881857:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ed2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd3b expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.881870:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ed2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd3b expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.881887:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690455.881889:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690455.881892:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ee00, rc 0) 00000100:00100000:0.0:1779690455.881972:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+46:104700:x1866137503655168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 280us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690455.881981:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 607 00000100:00100000:0.0:1779690455.885446:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690455.885582:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503655424 00000100:00100000:3.0:1779690455.885604:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503655424 00000100:00100000:2.0:1779690455.885796:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 608 00000100:00100000:2.0:1779690455.885849:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+46:104700:x1866137503655424:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1779690455.885939:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.885963:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.885984:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886634:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886646:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886652:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886668:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.886674:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886682:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886696:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:2.0:1779690455.886699:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690455.886705:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.886712:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed36 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690455.886946:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:104700:x1866137503655424:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 1136us (1510us total) trans 12884902178 rc 0/0 00000100:00100000:2.0:1779690455.886955:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 608 00000100:00100000:3.0:1779690455.890020:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690455.890106:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503655680 00000100:00100000:0.0:1779690455.890119:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503655680 00000100:00100000:0.0:1779690455.890226:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 609 00000100:00100000:0.0:1779690455.890239:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+47:104700:x1866137503655680:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690455.890650:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.890672:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690455.890687:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690455.890785:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902179 00000004:00010000:0.0:1779690455.890877:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bcf0caa2 reply state 00000000e439b7c3 transno 12884902180 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690455.890888:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690455.891000:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:104700:x1866137503655680:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 763us (993us total) trans 12884902180 rc 0/0 00000100:00100000:0.0:1779690455.891008:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 609 00000020:00080000:0.0:1779690455.891015:0:57560:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690455.894293:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894315:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894324:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894331:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690455.894336:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894345:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894368:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:3.0:1779690455.894372:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690455.894378:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690455.894385:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913ed3d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690455.894632:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690455.894715:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503655936 00000100:00100000:1.0:1779690455.894728:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503655936 00000100:00100000:1.0:1779690455.894791:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1779690455.894930:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+49:104700:x1866137503655936:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690455.895271:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:104700:x1866137503655936:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 470us (709us total) trans 12884902181 rc 0/0 00000100:00100000:1.0:1779690455.895278:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1779690455.922127:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.922255:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656064 00000100:00100000:2.0:1779690455.922267:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656064 00000100:00100000:2.0:1779690455.922376:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 610 00000100:00100000:2.0:1779690455.922387:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+50:104702:x1866137503656064:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690455.922419:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690455.922444:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd42 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922530:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922561:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922577:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922593:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922610:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922616:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922771:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913ed59 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922780:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913ed59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922787:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913ed59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690455.922855:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81:0x0]: returning size 512 00000004:00200000:2.0:1779690455.922860:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690455.922884:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913ed59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922895:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922908:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922912:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922916:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.922919:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922925:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922939:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690455.922943:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.922949:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922955:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913ed4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922969:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922975:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922981:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.922986:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.922995:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923000:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923008:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690455.923010:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.923013:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923018:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913ed52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923052:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd42 expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923067:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ce00/0xb4bb873a1913ed59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd42 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.923075:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690455.923077:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690455.923080:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170ce00, rc 0) 00000100:00100000:2.0:1779690455.923163:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:104702:x1866137503656064:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 778us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690455.923169:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 610 00000100:00100000:0.0:1779690455.927155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690455.927253:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656192 00000100:00100000:2.0:1779690455.927265:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656192 00000100:00100000:2.0:1779690455.927398:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 611 00000100:00100000:2.0:1779690455.927410:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+51:104702:x1866137503656192:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690455.927463:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690455.927490:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913ed60 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd49 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927574:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927591:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927613:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927630:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927752:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.927760:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928014:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928023:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928030:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690455.928076:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x83:0x0]: returning size 1516 00000004:00200000:2.0:1779690455.928088:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690455.928115:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928127:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928137:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928143:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928149:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928156:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.928160:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928168:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928181:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690455.928198:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.928204:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928210:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed67 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928223:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928240:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928245:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928250:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690455.928253:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928259:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928267:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0xe3b444b9 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690455.928269:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690455.928272:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928452:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed6e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928497:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913ed60 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd49 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928513:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd49 expref: 52 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690455.928520:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:2.0:1779690455.928523:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690455.928535:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d000, rc 0) 00000100:00100000:2.0:1779690455.928854:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+52:104702:x1866137503656192:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1398us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690455.928867:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 611 00000100:00100000:0.0:1779690456.520037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690456.520082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690456.520117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690456.520146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690456.520174:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690456.520221:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656576 00000100:00100000:0.0:1779690456.520252:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656576 00000100:00100000:0.0:1779690456.520326:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656832 00000100:00100000:0.0:1779690456.520330:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656832 00000100:00100000:0.0:1779690456.520353:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656448 00000100:00100000:0.0:1779690456.520355:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656448 00000100:00100000:0.0:1779690456.520377:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656704 00000100:00100000:0.0:1779690456.520380:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656704 00000100:00100000:0.0:1779690456.520404:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2854 00000100:00100000:0.0:1779690456.520415:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503656576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690456.520513:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503656576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690456.520521:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2854 00000100:00100000:0.0:1779690456.520542:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2855 00000100:00100000:0.0:1779690456.520547:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503656832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690456.520566:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+16:2389:x1866137503656832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690456.520570:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2855 00000100:00100000:0.0:1779690456.520577:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2856 00000100:00100000:0.0:1779690456.520580:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503656448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690456.520593:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503656448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 12us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690456.520670:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2856 00000100:00100000:0.0:1779690456.520682:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2857 00000100:00100000:0.0:1779690456.520689:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503656704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690456.520711:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503656704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690456.520723:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2857 00000100:00080000:0.0:1779690456.520746:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690456.520750:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690456.520998:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656320 00000100:00100000:1.0:1779690456.521004:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656320 00000100:00100000:1.0:1779690456.521049:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:1.0:1779690456.521056:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503656320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690456.521095:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503656320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690456.521102:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00010000:00010000:2.0:1779690456.525151:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690457.229087:0:66748:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690457.229096:0:66748:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690457.229611:0:66748:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690457.229621:0:66748:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690457.545451:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690457.592957:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902180 is committed 00000001:00080000:3.0:1779690457.593091:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902173 is committed 00000001:00080000:3.0:1779690457.593129:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902181 is committed 00000020:00080000:3.0:1779690457.593198:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018966 batchid updated 00000020:00080000:1.0:1779690457.593285:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018966 00000020:00080000:1.0:1779690457.593298:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018966 00000020:00000080:1.0:1779690457.907137:0:66800:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe9590f4d0 00000004:00000080:1.0:1779690457.907154:0:66800:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e30bb299800 uarg=0000000000000000 00000004:00000080:1.0:1779690457.907211:0:66800:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e30bb299800 00000040:00080000:1.0:1779690457.908969:0:66800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].6, 80 off8672 00000004:00000080:1.0:1779690457.909000:0:66800:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl6', mask 0x0 00000004:02000000:1.0:1779690457.909003:0:66800:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:0.0:1779690458.096745:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690458.097198:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503656960 00000100:00100000:2.0:1779690458.097209:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503656960 00000100:00100000:2.0:1779690458.097287:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 612 00000100:00100000:2.0:1779690458.097300:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:104750:x1866137503656960:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690458.097319:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690458.097340:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd50 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097405:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097421:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097434:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690458.097634:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81:0x0]: returning size 7680 00000004:00200000:2.0:1779690458.097639:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690458.097719:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097747:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd50 expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097777:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd50 expref: 45 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.097786:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690458.097789:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690458.097792:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c600, rc 0) 00000100:00100000:2.0:1779690458.097887:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+45:104750:x1866137503656960:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 590us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690458.097895:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 612 00000100:00080000:0.0:1779690458.098596:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690458.105744:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690458.105948:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657216 00000100:00100000:2.0:1779690458.105957:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657216 00000100:00100000:2.0:1779690458.106019:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18663 00000100:00100000:2.0:1779690458.106027:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+45:104750:x1866137503657216:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1779690458.106042:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1779690458.106067:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913ed75 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd49 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.106086:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913ed2f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd3b expref: 44 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.106097:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:2.0:1779690458.106109:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690458.106174:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:104750:x1866137503657216:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 147us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690458.106180:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18663 00000100:00100000:1.0:1779690458.112208:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690458.112304:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657344 00000100:00100000:2.0:1779690458.112313:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657344 00000100:00100000:2.0:1779690458.112367:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 613 00000100:00100000:2.0:1779690458.112377:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+43:104750:x1866137503657344:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:2.0:1779690458.112762:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.112780:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690458.112792:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690458.113112:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].27, 136 off11864 00000100:00100000:2.0:1779690458.113203:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+43:104750:x1866137503657344:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 827us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690458.113212:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 613 00010000:00010000:3.0:1779690458.570862:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690458.723695:0:66849:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690458.723707:0:66849:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690458.723790:0:66849:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 28 count 10 00000040:00080000:0.0:1779690458.723798:0:66849:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690458.765800:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690458.765831:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690458.765881:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 28 count 10 00000040:00080000:0.0:1779690458.765889:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690458.766051:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492322688:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690458.766192:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f96d5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1779690458.768675:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492322688:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690459.081197:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690459.081248:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492323200:0@lo:400:kworker.0 00000100:00100000:1.0:1779690459.081312:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492323328:0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081339:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690459.081358:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690459.081408:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492322816:0@lo:400:kworker.0 00000100:00100000:2.0:1779690459.081431:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323200 00000100:00100000:2.0:1779690459.081440:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323200 00000100:00100000:3.0:1779690459.081442:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690459.081491:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492322816 00000100:00100000:3.0:1779690459.081496:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492322816 00000100:00100000:2.0:1779690459.081519:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1779690459.081533:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492323200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081535:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1779690459.081546:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492322816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081595:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492322816:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690459.081603:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1779690459.081614:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492323200:12345-0@lo:400:kworker.0 Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690459.081621:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1779690459.081666:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690459.081669:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492323200:0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081680:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492322816:0@lo:400:kworker.0 00000100:00100000:2.0:1779690459.081683:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323328 00000100:00100000:2.0:1779690459.081688:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323328 00000100:00080000:3.0:1779690459.081716:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690459.081729:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:2.0:1779690459.081738:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492323328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081749:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492323072:0@lo:400:kworker.0 00000100:00100000:2.0:1779690459.081793:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492323328:12345-0@lo:400:kworker.0 Request processed in 56us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690459.081801:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690459.081830:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1779690459.081841:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492323712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690459.081858:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492323584:0@lo:400:kworker.0 00000100:00100000:2.0:1779690459.081865:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492322944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690459.081881:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690459.081897:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690459.081906:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690459.081934:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492323456:0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.081939:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323072 00000100:00100000:3.0:1779690459.081944:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323072 00000100:00100000:0.0:1779690459.081944:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323712 00000100:00100000:0.0:1779690459.081950:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323712 00000100:00100000:2.0:1779690459.081963:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690459.081992:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492322944 00000100:00100000:0.0:1779690459.081996:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492322944 00000100:00100000:3.0:1779690459.082002:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323584 00000100:00100000:3.0:1779690459.082014:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323584 00000100:00100000:2.0:1779690459.082024:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1779690459.082033:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492323712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690459.082065:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742588416 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690459.082103:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492323712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690459.082400:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492323328:0@lo:400:kworker.0 00000100:00100000:1.0:1779690459.082441:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323456 00000100:00100000:1.0:1779690459.082445:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323456 00000100:00100000:1.0:1779690459.082473:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:1.0:1779690459.082480:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492323456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690459.082524:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492323456:12345-0@lo:400:kworker.0 Request processed in 44us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690459.082530:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:1.0:1779690459.082549:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1779690459.082558:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492323072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690459.082593:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492323072:12345-0@lo:400:kworker.0 Request processed in 37us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690459.082599:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1779690459.082645:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492323712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690459.082671:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1779690459.082680:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492323584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.082716:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492323584:12345-0@lo:400:kworker.0 Request processed in 39us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690459.082732:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1779690459.082884:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492323072:0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.082895:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492323584:0@lo:400:kworker.0 00000100:00100000:3.0:1779690459.082930:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492323456:0@lo:400:kworker.0 00000100:00080000:3.0:1779690459.082953:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690459.082957:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690459.083861:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1779690459.083880:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492322944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690459.083901:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00002000:00000024:0.0:1779690459.083994:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690459.084172:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492322944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 300us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690459.084179:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1779690459.084234:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492322944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1779690459.593221:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690460.422649:0:66900:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690460.422661:0:66900:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690460.422739:0:66900:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 28 count 10 00000040:00080000:1.0:1779690460.422748:0:66900:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690460.457182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690460.457356:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657472 00000100:00100000:2.0:1779690460.457370:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657472 00000100:00100000:2.0:1779690460.458434:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 614 00000100:00100000:2.0:1779690460.458449:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:104768:x1866137503657472:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690460.458476:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690460.458502:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed91 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd57 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458583:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458601:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458634:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458651:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458657:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.458664:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459051:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459059:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459065:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690460.459108:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x83:0x0]: returning size 1516 00000004:00200000:2.0:1779690460.459113:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690460.459135:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459166:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459175:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459194:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459201:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459207:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690460.459212:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459220:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459234:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:2.0:1779690460.459237:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690460.459243:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459249:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ed98 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459260:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459266:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459271:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459276:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690460.459285:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459291:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459299:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0xe3b444b9 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690460.459307:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690460.459310:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459315:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ed9f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459352:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ed91 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd57 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459367:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd57 expref: 44 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.459374:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:2.0:1779690460.459376:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690460.459380:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170ca00, rc 0) 00000100:00100000:2.0:1779690460.459470:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+44:104768:x1866137503657472:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1026us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690460.459479:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 614 00000100:00080000:0.0:1779690460.462538:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690460.465149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690460.466042:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657728 00000100:00100000:0.0:1779690460.466059:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657728 00000100:00100000:1.0:1779690460.466575:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 615 00000100:00100000:1.0:1779690460.466588:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+44:104768:x1866137503657728:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:1.0:1779690460.466669:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1779690460.466706:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913eda6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x83:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd57 expref: 44 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466732:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:1.0:1779690460.466745:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913ed83 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd50 expref: 43 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466755:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:1.0:1779690460.466758:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690460.466787:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466826:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466838:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466855:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466863:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.466870:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.467295:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.467306:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.467323:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468359:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468374:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468384:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468392:0:57585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468400:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468408:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468444:0:57585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1779690460.468470:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468476:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468483:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468490:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690460.468501:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468510:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468523:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:1.0:1779690460.468527:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1779690460.468532:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468539:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913edbb lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468559:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468566:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468572:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468578:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690460.468581:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468587:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468594:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0x0 (ffff9e2f826ece00) 00010000:00010000:1.0:1779690460.468597:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690460.468605:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.468612:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913edad lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690460.468624:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003ddc0ead reply state 00000000025bde44 transno 12884902182 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690460.468635:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690460.468736:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+44:104768:x1866137503657728:12345-192.168.203.5@tcp:36:rm.0 Request processed in 2147us (3605us total) trans 12884902182 rc 0/0 00000100:00100000:1.0:1779690460.468747:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 615 00010000:00010000:0.0:1779690460.469968:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1779690460.469979:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690460.469990:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690460.469995:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690460.470003:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690460.470019:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:0.0:1779690460.470022:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1779690460.470026:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690460.470032:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913edc2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690460.470048:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690460.470049:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690460.470051:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690460.473124:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473154:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473162:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473177:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690460.473182:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473190:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473210:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81:0x0].0xe3b444b9 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690460.473213:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690460.473219:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690460.473234:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913edb4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690460.555092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690460.555230:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657856 00000100:00100000:2.0:1779690460.555394:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657856 00000100:00100000:2.0:1779690460.555507:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 616 00000100:00100000:2.0:1779690460.555518:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:104775:x1866137503657856:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690460.555563:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x83:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1779690460.555656:0:57561:0:(mdt_handler.c:8003:mdt_fid2path()) nonlocal object [0x200000bd2:0x83:0x0]: rc = -2 00000100:00100000:2.0:1779690460.555711:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+39:104775:x1866137503657856:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 195us (624us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690460.555724:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 616 00000100:00080000:1.0:1779690460.556428:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690460.565988:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690460.566950:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503657984 00000100:00100000:2.0:1779690460.566960:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503657984 00000100:00100000:2.0:1779690460.567016:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 617 00000100:00100000:2.0:1779690460.567026:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:104775:x1866137503657984:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690460.567093:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567110:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567121:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567149:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567157:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567163:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567239:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567255:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567261:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567267:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690460.567270:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567277:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567288:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690460.567291:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690460.567295:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567301:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913edc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567312:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567317:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567323:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567328:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690460.567335:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567341:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567349:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xa65b976d (ffff9e2f826ec600) 00010000:00010000:2.0:1779690460.567351:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690460.567354:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690460.567360:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913edd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa65b976d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690460.567432:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:104775:x1866137503657984:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 407us (1451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690460.567440:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 617 00000100:00100000:3.0:1779690460.577925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690460.577958:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658240 00000100:00100000:3.0:1779690460.577966:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658240 00000100:00100000:3.0:1779690460.578010:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 618 00000100:00100000:3.0:1779690460.578019:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:104775:x1866137503658240:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690460.578156:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578172:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578184:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578193:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578200:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578219:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578224:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690460.578228:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578236:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.578245:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:3.0:1779690460.578249:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690460.578253:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.579351:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edd7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x83:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580064:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580075:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580082:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580088:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690460.580092:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580110:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.580124:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x83:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:3.0:1779690460.580127:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1779690460.580131:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690460.582354:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ed8a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x83:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690460.583485:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104775:x1866137503658240:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 5460us (5560us total) trans 12884902183 rc 0/0 00000100:00100000:3.0:1779690460.583496:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 618 00000040:00080000:3.0:1779690460.583632:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690460.583637:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690460.587384:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:3.0:1779690460.587399:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690460.616901:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690461.168239:0:66952:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690461.168252:0:66952:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690461.168324:0:66952:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 28 count 10 00000040:00080000:0.0:1779690461.168331:0:66952:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690461.250608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690461.250743:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658368 00000100:00100000:0.0:1779690461.250752:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658368 00000100:00100000:0.0:1779690461.250822:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 619 00000100:00100000:0.0:1779690461.250832:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658368:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690461.251019:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658368:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 188us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690461.251026:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 619 00000100:00100000:0.0:1779690461.259763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690461.259861:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658496 00000100:00100000:3.0:1779690461.259870:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658496 00000100:00100000:3.0:1779690461.259924:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 620 00000100:00100000:3.0:1779690461.259934:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658496:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1779690461.260082:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690461.260190:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658496:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 257us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.260197:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 620 00000100:00100000:3.0:1779690461.262082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690461.262167:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658624 00000100:00100000:0.0:1779690461.262175:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658624 00000100:00100000:0.0:1779690461.262226:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 621 00000100:00100000:0.0:1779690461.262235:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658624:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690461.262368:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690461.262449:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658624:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 214us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690461.262458:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 621 00000100:00100000:3.0:1779690461.265354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.265419:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658752 00000100:00100000:2.0:1779690461.265428:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658752 00000100:00100000:2.0:1779690461.265477:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 622 00000100:00100000:2.0:1779690461.265486:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690461.265632:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690461.265749:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 264us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690461.265757:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 622 00000100:00100000:0.0:1779690461.272313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690461.272395:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503658880 00000100:00100000:3.0:1779690461.272405:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503658880 00000100:00100000:3.0:1779690461.272463:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 623 00000100:00100000:3.0:1779690461.272473:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658880:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690461.272577:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503658880:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.272584:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 623 00000100:00100000:0.0:1779690461.278869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690461.279093:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659008 00000100:00100000:3.0:1779690461.279105:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659008 00000100:00100000:3.0:1779690461.279176:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 624 00000100:00100000:3.0:1779690461.279189:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659008:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690461.279365:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659008:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 179us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.279374:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 624 00000100:00100000:3.0:1779690461.289695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690461.289783:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659136 00000100:00100000:1.0:1779690461.289792:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659136 00000100:00100000:1.0:1779690461.289866:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 625 00000100:00100000:1.0:1779690461.289876:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659136:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690461.290041:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659136:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690461.290049:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 625 00000100:00100000:3.0:1779690461.292046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690461.292075:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659264 00000100:00100000:3.0:1779690461.292081:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659264 00000100:00100000:3.0:1779690461.292117:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 626 00000100:00100000:3.0:1779690461.292125:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659264:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690461.292270:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:104790:x1866137503659264:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 145us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.292277:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 626 00000100:00100000:2.0:1779690461.634008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.634099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.634134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.634181:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.634201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690461.634233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690461.634453:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659648 00000100:00100000:3.0:1779690461.634462:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659648 00000100:00100000:3.0:1779690461.634534:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659904 00000100:00100000:3.0:1779690461.634537:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659904 00000100:00100000:3.0:1779690461.634553:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659520 00000100:00100000:3.0:1779690461.634556:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659520 00000100:00100000:3.0:1779690461.634574:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660032 00000100:00100000:3.0:1779690461.634586:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660032 00000100:00100000:3.0:1779690461.634610:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2860 00000100:00100000:3.0:1779690461.634620:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503659648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690461.634685:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503659648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.634693:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2860 00000100:00100000:3.0:1779690461.634723:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2861 00000100:00100000:3.0:1779690461.634729:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503659904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690461.634752:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503659904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.634758:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2861 00000100:00100000:3.0:1779690461.634768:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2862 00000100:00100000:3.0:1779690461.634773:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503659520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690461.634794:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503659520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.634800:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2862 00000100:00100000:3.0:1779690461.634834:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2863 00000100:00100000:3.0:1779690461.634841:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503660032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690461.634863:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503660032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690461.634878:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2863 00000100:00080000:3.0:1779690461.634895:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690461.634899:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690461.635349:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659392 00000100:00100000:1.0:1779690461.635355:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659392 00000100:00100000:1.0:1779690461.635579:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:1.0:1779690461.635589:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503659392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690461.635628:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503659392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690461.635636:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:2.0:1779690461.636198:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503659776 00000100:00100000:2.0:1779690461.636204:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503659776 00000100:00100000:2.0:1779690461.636300:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:2.0:1779690461.636307:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+43:2390:x1866137503659776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690461.636480:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+43:2390:x1866137503659776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 173us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690461.636496:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00010000:00010000:2.0:1779690461.640951:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690462.665301:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690462.706471:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902182 is committed 00000001:00080000:1.0:1779690462.706496:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902183 is committed 00000040:00080000:0.0:1779690463.689064:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690463.689072:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690463.689679:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 28 count 8 00000040:00080000:0.0:1779690463.689687:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690463.690704:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690464.201289:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492323840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690464.201397:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.201399:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492323968:0@lo:400:kworker.0 00000100:00100000:0.0:1779690464.201477:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492324224:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.201980:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.202030:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492324480:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.202072:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.202114:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1779690464.202122:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492324096:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.202151:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.202170:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492324608:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.202192:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.202232:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323968 00000100:00100000:3.0:1779690464.202240:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323968 00000100:00100000:3.0:1779690464.202292:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1779690464.202302:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492323968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.202427:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492323968:12345-0@lo:400:kworker.0 Request processed in 125us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690464.202435:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1779690464.202475:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324480 00000100:00100000:3.0:1779690464.202480:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324480 00000100:00100000:3.0:1779690464.202522:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:3.0:1779690464.202528:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492324480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.202564:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492324480:12345-0@lo:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690464.202652:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:3.0:1779690464.202795:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324096 00000100:00100000:3.0:1779690464.202801:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324096 00000100:00100000:3.0:1779690464.202922:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324608 00000100:00100000:3.0:1779690464.202926:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324608 00000100:00100000:3.0:1779690464.202951:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1779690464.202958:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203002:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492324096:12345-0@lo:400:kworker.0 Request processed in 46us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690464.203010:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1779690464.203023:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1779690464.203030:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492324608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203054:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492324608:12345-0@lo:400:kworker.0 Request processed in 26us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690464.203060:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1779690464.203086:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690464.203091:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690464.203159:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492324096:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203171:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492324608:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203179:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492323968:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203190:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492324480:0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.203274:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492323840 00000100:00100000:3.0:1779690464.203278:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492323840 00000100:00100000:3.0:1779690464.203309:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1779690464.203316:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492323840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690464.204057:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690464.204058:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492324352:0@lo:400:kworker.0 00002000:00000024:3.0:1779690464.204112:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690464.204130:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690464.204162:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492323840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 845us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690464.204168:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492324736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690464.204171:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1779690464.204183:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492323840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690464.204230:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324352 00000100:00100000:3.0:1779690464.204235:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324352 00000100:00100000:2.0:1779690464.204260:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324224 00000100:00100000:2.0:1779690464.204265:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324224 00000100:00100000:3.0:1779690464.204281:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:3.0:1779690464.204291:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492324352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690464.204307:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1779690464.204316:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690464.204345:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492324352:12345-0@lo:400:kworker.0 Request processed in 46us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690464.204352:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:2.0:1779690464.204359:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492324224:12345-0@lo:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690464.204367:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1779690464.204376:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690464.204382:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690464.204403:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492324352:0@lo:400:kworker.0 00000100:00100000:0.0:1779690464.206375:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690464.206468:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492324224:0@lo:400:kworker.0 00000100:00100000:2.0:1779690464.206652:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492324736 00000100:00100000:2.0:1779690464.206676:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492324736 00000100:00100000:2.0:1779690464.206736:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1779690464.206746:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492324736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690464.206793:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742588416 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690464.206897:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492324736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690464.206906:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1779690464.207160:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492324736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690464.716251:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690465.424391:0:67152:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690465.424397:0:67152:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690465.424438:0:67152:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 7 count 2 00000040:00080000:0.0:1779690465.424445:0:67152:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690465.469868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690465.470002:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660160 00000100:00100000:1.0:1779690465.470012:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660160 00000100:00100000:1.0:1779690465.470074:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 627 00000100:00100000:1.0:1779690465.470085:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:105232:x1866137503660160:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:1.0:1779690465.470150:0:57559:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b39a8548 uarg=0000000000000000 00000004:00000080:1.0:1779690465.470186:0:57559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b39a8548 00000004:00000080:1.0:1779690465.470191:0:57559:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=6, endrec=0 00000040:00080000:1.0:1779690465.470263:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690465.470268:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690465.470299:0:57559:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl6 endrec = 22 00000040:00080000:1.0:1779690465.470387:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 7 count 2 00000040:00080000:1.0:1779690465.470394:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690465.470398:0:57559:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl6 entries up to 18446744073709551615 00000040:00080000:1.0:1779690465.470430:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690465.470433:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690465.470748:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 22 count 1 00000040:00080000:1.0:1779690465.470754:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1779690465.470864:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+39:105232:x1866137503660160:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 780us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690465.470873:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 627 00000100:00080000:3.0:1779690465.471032:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690465.738450:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1779690466.073375:0:67200:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffd64036b80 00000004:00000080:3.0:1779690466.073393:0:67200:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e2f8d8d9000 uarg=0000000000000000 00000004:00000080:3.0:1779690466.073430:0:67200:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e2f8d8d9000 00000004:00000080:3.0:1779690466.073437:0:67200:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=6, endrec=0 00000040:00080000:3.0:1779690466.073535:0:67200:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690466.073539:0:67200:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1779690466.073574:0:67200:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl6 endrec = 22 00000040:00080000:3.0:1779690466.073638:0:67200:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 7 count 2 00000040:00080000:3.0:1779690466.073644:0:67200:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690466.073677:0:67200:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl6 entries up to 18446744073709551615 00000040:00080000:3.0:1779690466.073725:0:67200:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690466.073728:0:67200:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1779690466.074566:0:67200:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:3.0:1779690466.074574:0:67200:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1779690466.074601:0:67200:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=6 00000040:00080000:3.0:1779690466.074654:0:67200:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690466.074657:0:67200:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690466.076063:0:67200:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 6 count 1 00000040:00080000:3.0:1779690466.076072:0:67200:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690466.076118:0:67200:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1779690466.076120:0:67200:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1779690466.079767:0:67200:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl6 record=18446744073709551615 00000040:00080000:2.0:1779690466.080030:0:67200:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690466.080035:0:67200:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690466.081966:0:67200:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690466.081980:0:67200:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1779690466.082372:0:67200:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690466.082376:0:67200:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690466.083364:0:67200:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690466.083373:0:67200:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:1.0:1779690466.691086:0:67248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690466.691096:0:67248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690466.691631:0:67248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690466.691640:0:67248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690466.753356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753445:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.753621:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660800 00000100:00100000:2.0:1779690466.753630:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660800 00000100:00100000:2.0:1779690466.753686:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660416 00000100:00100000:2.0:1779690466.753689:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660416 00000100:00100000:3.0:1779690466.753739:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660288 00000100:00100000:3.0:1779690466.753743:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660288 00000100:00100000:3.0:1779690466.753772:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:3.0:1779690466.753792:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503660288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.753870:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503660288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 90us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.753878:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:3.0:1779690466.753911:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660544 00000100:00100000:3.0:1779690466.753914:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660544 00000100:00100000:3.0:1779690466.753952:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661056 00000100:00100000:3.0:1779690466.753956:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661056 00000100:00100000:3.0:1779690466.753988:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660672 00000100:00100000:3.0:1779690466.753991:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660672 00000100:00100000:3.0:1779690466.754011:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503660928 00000100:00100000:3.0:1779690466.754013:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503660928 00000100:00100000:3.0:1779690466.754030:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2866 00000100:00100000:3.0:1779690466.754036:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503660544:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.754064:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503660544:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.754093:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2866 00000100:00100000:3.0:1779690466.754106:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2867 00000100:00100000:3.0:1779690466.754112:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503661056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.754135:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+16:2390:x1866137503661056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.754141:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2867 00000100:00100000:3.0:1779690466.754292:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2868 00000100:00100000:3.0:1779690466.754299:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503660672:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.754324:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503660672:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.754330:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2868 00000100:00100000:3.0:1779690466.754342:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2869 00000100:00100000:3.0:1779690466.754348:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503660928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.754369:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503660928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.754374:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2869 00000100:00080000:0.0:1779690466.756176:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690466.756183:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690466.756186:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690466.760086:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:3.0:1779690466.760106:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+42:2390:x1866137503660800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.760195:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+42:2390:x1866137503660800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (6721us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.760202:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:3.0:1779690466.760224:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:3.0:1779690466.760238:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:2390:x1866137503660416:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690466.760267:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:2390:x1866137503660416:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.760274:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 180 00010000:00010000:3.0:1779690466.767083:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690466.939761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690466.940668:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661184 00000100:00100000:3.0:1779690466.940679:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661184 00000100:00100000:3.0:1779690466.940800:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 628 00000100:00100000:3.0:1779690466.940856:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:104656:x1866137503661184:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1779690466.940974:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+39:104656:x1866137503661184:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 122us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690466.940982:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 628 00000100:00100000:1.0:1779690466.944414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690466.944619:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661440 00000100:00100000:2.0:1779690466.944638:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661440 00000100:00100000:2.0:1779690466.944881:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:2.0:1779690466.944893:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+39:104656:x1866137503661440:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690466.946256:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+40:104656:x1866137503661440:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1361us (1845us total) trans 12884902184 rc 0/0 00000100:00100000:2.0:1779690466.946268:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:1.0:1779690467.137923:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690467.138123:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661568 00000100:00100000:2.0:1779690467.138132:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661568 00000100:00100000:2.0:1779690467.138236:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18664 00000100:00100000:2.0:1779690467.138247:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+16:2391:x1866137503661568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690467.138262:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:2.0:1779690467.138300:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913ec64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedcfc expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690467.138379:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085b461b4/0xb4bb873a1913df4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed8f7 expref: 15 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690467.138402:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2db83d8/0xb4bb873a1913dda0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed872 expref: 14 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690467.138418:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1c4:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:2.0:1779690467.138421:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1c4:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138423:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1c4:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138425:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1c4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1779690467.138432:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091c88d67/0xb4bb873a1913c5d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed1b1 expref: 13 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690467.138471:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1c3:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:2.0:1779690467.138473:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1c3:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138475:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1c3:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138477:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1c3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1779690467.138486:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba2d9b4/0xb4bb873a1913c52e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed16b expref: 12 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690467.138502:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1c2:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:2.0:1779690467.138504:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1c2:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138507:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1c2:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138508:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1c2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1779690467.138515:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141b9c34/0xb4bb873a1913c45c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed0e6 expref: 11 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690467.138543:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1c1:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:2.0:1779690467.138545:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1c1:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138547:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1c1:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:2.0:1779690467.138549:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1c1:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1779690467.138556:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6c210b/0xb4bb873a1913c39f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed099 expref: 10 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690467.138575:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913c199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750becf73 expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690467.138595:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19131ad4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x177:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750be8146 expref: 8 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690467.138611:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690467.138670:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503661568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 424us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690467.138678:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18664 00010000:00010000:2.0:1779690467.787491:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690467.818315:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902184 is committed 00000001:02000400:3.0:1779690468.092680:0:67297:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 02:27:47 (1779690467) 00000100:00100000:1.0:1779690468.338336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.338539:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661824 00000100:00100000:3.0:1779690468.338549:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661824 00000100:00100000:3.0:1779690468.338625:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 629 00000100:00100000:3.0:1779690468.338635:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+39:105445:x1866137503661824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690468.338657:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.338676:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd5e expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338740:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338754:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338782:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338795:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338802:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.338832:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1779690468.339328:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690468.339660:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913edf3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.339671:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913edf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.339678:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913edf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690468.339690:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1779690468.340568:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340580:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340587:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340594:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.340598:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340606:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340619:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:2.0:1779690468.340622:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.340627:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340633:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913ede5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340647:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340660:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340667:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340671:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.340674:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340679:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340686:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f905ad000) 00010000:00010000:2.0:1779690468.340688:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.340690:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.340696:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913edec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.341178:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913edde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd5e expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.341195:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913edf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd5e expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.341203:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690468.341206:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.341214:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267400, rc 0) 00000100:00100000:2.0:1779690468.341310:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:105445:x1866137503661824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2676us (2982us total) trans 12884902185 rc 0/0 00000100:00100000:2.0:1779690468.341318:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 629 00000100:00100000:1.0:1779690468.348091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690468.348187:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503661952 00000100:00100000:0.0:1779690468.348195:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503661952 00000100:00100000:0.0:1779690468.348247:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 630 00000100:00100000:0.0:1779690468.348257:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:105445:x1866137503661952:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690468.348359:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+41:105445:x1866137503661952:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690468.348366:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 630 00000100:00100000:1.0:1779690468.351640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.351858:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662080 00000100:00100000:2.0:1779690468.351867:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662080 00000100:00100000:2.0:1779690468.351927:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18665 00000100:00100000:2.0:1779690468.351937:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+41:2389:x1866137503662080:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690468.351962:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690468.351987:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913edf3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd5e expref: 41 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.352005:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690468.352009:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690468.352068:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+40:2389:x1866137503662080:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690468.352076:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18665 00000100:00100000:1.0:1779690468.359518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.359661:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662208 00000100:00100000:3.0:1779690468.359671:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662208 00000100:00100000:3.0:1779690468.359741:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 631 00000100:00100000:3.0:1779690468.359750:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+42:105446:x1866137503662208:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690468.359771:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.359791:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd65 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.359902:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.359915:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.359926:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.359988:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.359995:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360002:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360252:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360261:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360267:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360273:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.360278:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360295:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360306:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:3.0:1779690468.360309:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.360313:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360320:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360332:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360338:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360342:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360347:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.360349:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360354:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360360:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17321ebd (ffff9e2f905ad500) 00010000:00010000:3.0:1779690468.360362:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.360364:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360378:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1779690468.360520:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690468.360568:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd65 expref: 43 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360579:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:3.0:1779690468.360581:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.360585:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd65 expref: 43 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.360594:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690468.360731:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+42:105446:x1866137503662208:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 981us (1223us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690468.360739:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 631 00000100:00100000:3.0:1779690468.365599:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.365726:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662464 00000100:00100000:2.0:1779690468.365736:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662464 00000100:00100000:2.0:1779690468.365794:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 632 00000100:00100000:2.0:1779690468.365842:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+42:105446:x1866137503662464:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:2.0:1779690468.365895:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690468.365933:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913ecc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd18 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.365952:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690468.365957:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690468.366611:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.366627:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.366637:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.366690:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 39 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.366704:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 39 pid: 57559 timeout: 3295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690468.366718:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492324864:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690468.367067:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1779690468.369556:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492324864:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690468.369582:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690468.372876:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690468.373912:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662592 00000100:00100000:1.0:1779690468.373936:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662592 00010000:00010000:1.0:1779690468.373975:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 40 pid: 57559 timeout: 3295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690468.374017:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3247 00000100:00100000:1.0:1779690468.374026:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+40:2392:x1866137503662592:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690468.374039:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690468.374045:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 40 pid: 57559 timeout: 3295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374066:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 40 pid: 57559 timeout: 3295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374089:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913ecf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd26 expref: 40 pid: 57559 timeout: 3295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374106:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:1.0:1779690468.374111:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374120:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374127:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690468.374158:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690468.374220:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+39:2392:x1866137503662592:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 185us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690468.374237:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3247 00010000:00010000:2.0:1779690468.374479:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.374488:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.374512:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.374533:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.374541:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690468.376222:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x84:0x0]: returning size 512 00010000:00010000:2.0:1779690468.376238:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376248:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376255:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376261:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.376266:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376272:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376286:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:2.0:1779690468.376289:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.376294:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.376300:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690468.376331:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d6c29aed reply state 00000000b66a8827 transno 12884902186 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690468.376340:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690468.376616:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+43:105446:x1866137503662464:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 10810us (11020us total) trans 12884902186 rc 0/0 00000100:00100000:2.0:1779690468.376625:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 632 00010000:00010000:3.0:1779690468.379475:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379491:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379499:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379506:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.379560:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379582:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379599:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17321ebd (ffff9e2f826ecd00) 00010000:00010000:3.0:1779690468.379602:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.379607:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.379614:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ee1d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690468.386843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.387143:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662720 00000100:00100000:3.0:1779690468.387153:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662720 00000100:00100000:3.0:1779690468.387221:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 633 00000100:00100000:3.0:1779690468.387231:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+42:105447:x1866137503662720:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1779690468.387253:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.387274:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd6c expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387336:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387350:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387362:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690468.387422:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690468.387438:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 106 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690468.387467:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387490:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd6c expref: 44 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387505:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd6c expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.387513:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:3.0:1779690468.387516:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690468.387519:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266200, rc 0) 00000100:00100000:3.0:1779690468.387581:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+43:105447:x1866137503662720:12345-192.168.203.5@tcp:101:bash.0 Request processed in 351us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690468.387587:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 633 00000100:00100000:0.0:1779690468.391902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.392986:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662848 00000100:00100000:2.0:1779690468.392996:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662848 00000100:00100000:2.0:1779690468.393065:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 634 00000100:00100000:2.0:1779690468.393076:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+43:105447:x1866137503662848:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690468.393098:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690468.393118:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd73 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393178:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393193:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393204:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393218:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393225:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393257:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393380:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ee47 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.393390:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ee47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394071:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ee47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690468.394113:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x84:0x0]: returning size 512 00000004:00200000:2.0:1779690468.394118:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690468.394141:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ee47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394154:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394161:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394169:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394175:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.394179:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394186:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394208:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:2.0:1779690468.394211:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.394216:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394223:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394236:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.394242:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395745:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395752:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.395755:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395763:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395777:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17321ebd (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690468.395780:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.395784:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395790:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395879:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd73 expref: 45 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395892:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c000/0xb4bb873a1913ee47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd73 expref: 44 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.395902:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690468.395904:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690468.395906:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c000, rc 0) 00000100:00100000:2.0:1779690468.395969:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+44:105447:x1866137503662848:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2894us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690468.395978:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 634 00000100:00100000:0.0:1779690468.408085:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.408506:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503662976 00000100:00100000:2.0:1779690468.408515:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503662976 00000100:00100000:2.0:1779690468.408576:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 635 00000100:00100000:2.0:1779690468.408587:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:105447:x1866137503662976:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690468.408610:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690468.408632:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee4e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd7a expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408693:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408706:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408718:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408753:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408761:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408767:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408933:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408941:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408947:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408952:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.408956:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408963:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408975:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690468.408979:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.408983:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.408989:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee55 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409008:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409014:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409019:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409025:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.409027:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409033:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409040:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690468.409043:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.409045:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409051:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee5c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409091:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee4e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd7a expref: 45 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409102:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690468.409105:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.409115:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee4e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd7a expref: 45 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.409125:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c800, rc 0) 00000100:00100000:2.0:1779690468.409177:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:105447:x1866137503662976:12345-192.168.203.5@tcp:101:bash.0 Request processed in 592us (1101us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690468.409185:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 635 00000100:00100000:1.0:1779690468.419940:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.420012:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663104 00000100:00100000:3.0:1779690468.420022:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663104 00000100:00100000:3.0:1779690468.420126:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 636 00000100:00100000:3.0:1779690468.420136:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+39:105448:x1866137503663104:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690468.420157:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.420178:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd81 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420241:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420255:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420285:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690468.420344:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690468.420348:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 106 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690468.420369:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420392:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 41 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420408:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 40 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.420416:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:3.0:1779690468.420418:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690468.420422:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266600, rc 0) 00000100:00100000:3.0:1779690468.420480:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+40:105448:x1866137503663104:12345-192.168.203.5@tcp:101:rm.0 Request processed in 346us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690468.420487:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 636 00000100:00100000:0.0:1779690468.422926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.423016:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663232 00000100:00100000:2.0:1779690468.423024:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663232 00000100:00100000:2.0:1779690468.423081:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 637 00000100:00100000:2.0:1779690468.423091:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+40:105448:x1866137503663232:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690468.423106:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690468.423122:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd88 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423185:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423199:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423208:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423221:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423227:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423232:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423343:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ee86 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423351:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ee86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423358:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ee86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690468.423388:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x84:0x0]: returning size 512 00000004:00200000:2.0:1779690468.423392:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690468.423413:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ee86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423424:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423430:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423436:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423442:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.423446:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423453:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423464:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:2.0:1779690468.423473:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.423478:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423485:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913ee78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423497:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423503:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423521:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423526:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.423529:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423534:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423541:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17321ebd (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690468.423544:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.423546:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423551:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913ee7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423578:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913ee71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd88 expref: 42 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423604:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c200/0xb4bb873a1913ee86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd88 expref: 41 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.423610:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690468.423613:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690468.423615:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c200, rc 0) 00000100:00100000:2.0:1779690468.423673:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:105448:x1866137503663232:12345-192.168.203.5@tcp:101:rm.0 Request processed in 584us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690468.423681:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 637 00000100:00100000:1.0:1779690468.427180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.427242:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663360 00000100:00100000:3.0:1779690468.427251:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663360 00000100:00100000:3.0:1779690468.427340:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 638 00000100:00100000:3.0:1779690468.427351:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:105448:x1866137503663360:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690468.427368:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.427385:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee8d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd8f expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427469:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427482:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427495:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427518:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427525:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427532:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427587:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427594:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427600:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427605:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.427610:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427626:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427638:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.427641:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.427645:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427650:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913ee94 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427662:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427667:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427673:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427679:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.427681:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427686:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427693:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f905adc00) 00010000:00010000:3.0:1779690468.427695:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.427697:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427710:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ee9b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427741:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee8d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd8f expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427750:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.427752:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.427756:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913ee8d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd8f expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.427765:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690468.427857:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:105448:x1866137503663360:12345-192.168.203.5@tcp:101:rm.0 Request processed in 508us (684us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690468.427865:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 638 00000100:00100000:1.0:1779690468.432654:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.433013:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663488 00000100:00100000:3.0:1779690468.433022:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663488 00000100:00100000:3.0:1779690468.433088:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 639 00000100:00100000:3.0:1779690468.433099:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:105448:x1866137503663488:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690468.433119:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.433138:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eea2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd96 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433213:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433228:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433252:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433267:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433274:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433280:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433344:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433351:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433357:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433362:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.433367:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433373:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433383:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.433386:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.433390:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433402:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eea9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433415:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433420:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433426:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433431:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.433434:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433440:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433447:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f905adc00) 00010000:00010000:3.0:1779690468.433449:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.433452:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433457:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eeb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433486:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eea2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd96 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433518:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.433521:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.433525:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eea2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd96 expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.433535:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690468.433593:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:105448:x1866137503663488:12345-192.168.203.5@tcp:101:rm.0 Request processed in 496us (950us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690468.433610:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 639 00000100:00100000:1.0:1779690468.445255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690468.445355:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663616 00000100:00100000:0.0:1779690468.445365:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663616 00000100:00100000:0.0:1779690468.445422:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 640 00000100:00100000:0.0:1779690468.445447:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:105449:x1866137503663616:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690468.445466:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690468.445487:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eeb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedd9d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445566:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445580:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445591:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445619:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445625:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445632:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445692:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445699:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445705:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445722:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690468.445726:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445734:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445746:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:0.0:1779690468.445749:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690468.445753:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445758:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913eebe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445773:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445779:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445784:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445790:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690468.445792:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445798:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445872:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690468.445874:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690468.445877:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445883:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913eec5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445913:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eeb7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd9d expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445922:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:0.0:1779690468.445924:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690468.445927:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913eeb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd9d expref: 42 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.445935:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f800, rc 0) 00000100:00100000:0.0:1779690468.445991:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+41:105449:x1866137503663616:12345-192.168.203.5@tcp:101:cp.0 Request processed in 547us (744us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690468.445998:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 640 00000100:00100000:1.0:1779690468.452892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.452983:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503663744 00000100:00100000:3.0:1779690468.452993:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503663744 00000100:00100000:3.0:1779690468.453048:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 641 00000100:00100000:3.0:1779690468.453070:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:105449:x1866137503663744:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690468.453090:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.453108:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eecc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedda4 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453172:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453186:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453198:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453212:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453233:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453240:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453301:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453309:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453315:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453319:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.453324:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453330:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453341:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.453344:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.453349:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453354:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913eed3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453365:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453378:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453383:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453388:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.453391:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453398:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453405:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f905adc00) 00010000:00010000:3.0:1779690468.453407:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.453410:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453417:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913eeda lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453449:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eecc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedda4 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453459:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690468.453468:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.453472:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913eecc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedda4 expref: 42 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.453499:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690468.453565:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+41:105449:x1866137503663744:12345-192.168.203.5@tcp:101:cp.0 Request processed in 507us (680us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690468.453572:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 641 00000100:00100000:1.0:1779690468.459080:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.459171:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664000 00000100:00100000:2.0:1779690468.459181:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664000 00000100:00100000:2.0:1779690468.459293:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 642 00000100:00100000:2.0:1779690468.459306:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+41:105449:x1866137503664000:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690468.459327:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690468.459348:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eee1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddab expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459480:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459495:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459506:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459519:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459539:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.459546:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690468.460280:0:57559:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ec:0x0], index 0: 0 00010000:00010000:2.0:1779690468.460432:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460442:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460450:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460481:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460488:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460494:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460500:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690468.460504:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460511:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460533:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:2.0:1779690468.460536:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690468.460541:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460546:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913eee8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690468.460559:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f81fb247 reply state 00000000b49f42fd transno 12884902187 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690468.460566:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690468.460596:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913eee1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 44 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460608:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 43 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.460616:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690468.460618:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690468.460620:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c600, rc 0) 00000100:00100000:2.0:1779690468.460675:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+44:105449:x1866137503664000:12345-192.168.203.5@tcp:101:cp.0 Request processed in 1373us (1604us total) trans 12884902187 rc 0/0 00000100:00100000:2.0:1779690468.460683:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 642 00010000:00010000:3.0:1779690468.465146:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465165:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465173:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465179:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690468.465183:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465191:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465207:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f826ecc00) 00010000:00010000:3.0:1779690468.465210:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690468.465214:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.465220:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913eeef lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690468.465881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.466135:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664128 00000100:00100000:3.0:1779690468.466157:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664128 00000100:00100000:3.0:1779690468.466234:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6421 00000100:00100000:3.0:1779690468.466243:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503664128:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690468.466260:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690468.466278:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddb2 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690468.466305:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690468.466329:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690468.466331:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690468.466339:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.466360:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690468.466372:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690468.466425:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503664128:12345-192.168.203.5@tcp:101:cp.0 Request processed in 183us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690468.466432:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6421 00000100:00080000:1.0:1779690468.466777:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690468.469360:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690468.472016:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664256 00000100:00100000:0.0:1779690468.472029:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664256 00000100:00100000:0.0:1779690468.473474:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6422 00000100:00100000:0.0:1779690468.473493:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:105449:x1866137503664256:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690468.473512:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690468.473530:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddb9 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.473581:0:49882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.473590:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690468.473591:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690468.473595:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 9 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.473629:0:49882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.473643:0:49882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 9 pid: 6583 timeout: 3296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690468.473656:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492324992:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690468.473760:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8cd31480 going to sleep for 11 seconds 00000100:00100000:1.0:1779690468.481039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690468.483163:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664384 00000100:00100000:2.0:1779690468.483176:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664384 00010000:00010000:2.0:1779690468.483218:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 10 pid: 6583 timeout: 3296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690468.483284:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3248 00000100:00100000:2.0:1779690468.483294:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503664384:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690468.483309:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690468.483333:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 10 pid: 6583 timeout: 3296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.483347:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 10 pid: 6583 timeout: 3296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.483372:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690468.483375:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690468.483382:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 10 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.483393:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 10 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690468.483429:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 10 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690468.483444:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492325120:192.168.203.5@tcp:105: 00000100:00100000:2.0:1779690468.483530:0:5780:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8000 going to sleep for 11 seconds 00010000:00010000:0.0:1779690468.483654:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26c14c4/0xb4bb873a1913ef04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb2 expref: 10 pid: 6583 timeout: 3296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690468.483669:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492324992:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690468.483694:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 9 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690468.483704:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f800, rc 0) 00000100:00100000:0.0:1779690468.483739:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:105449:x1866137503664256:12345-192.168.203.5@tcp:101:cp.0 Request processed in 10255us (14389us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690468.483746:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6422 00000100:00100000:2.0:1779690468.488024:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690468.488101:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664640 00000100:00100000:3.0:1779690468.488110:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664640 00000100:00100000:1.0:1779690468.488133:0:5780:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492325120:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690468.488153:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690468.488170:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:3.0:1779690468.488179:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+43:105449:x1866137503664640:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:1.0:1779690468.488208:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503664384:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 4916us (7177us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690468.488215:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3248 00000100:00100000:3.0:1779690468.488529:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+44:105449:x1866137503664640:12345-192.168.203.5@tcp:35:cp.0 Request processed in 349us (512us total) trans 12884902188 rc 0/0 00000100:00100000:3.0:1779690468.488536:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 89 00000040:00080000:3.0:1779690468.809851:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690468.809859:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690468.810958:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 8 00000040:00080000:3.0:1779690468.810970:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690468.811038:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690469.320942:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690469.320964:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492325248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690469.321043:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690469.321063:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492325760:0@lo:400:kworker.0 00000100:00100000:1.0:1779690469.321102:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690469.321134:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492325632:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.321185:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690469.321200:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325248 00000100:00100000:0.0:1779690469.321209:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325248 00000100:00100000:3.0:1779690469.321214:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492326144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690469.321244:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690469.321270:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492326144 00000100:00100000:0.0:1779690469.321274:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492326144 00000100:00100000:3.0:1779690469.321281:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bb060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492325376:0@lo:400:kworker.0 00000100:00100000:0.0:1779690469.321296:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1779690469.321307:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492325248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690469.321315:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690469.321344:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492325888:0@lo:400:kworker.0 00002000:00000024:0.0:1779690469.321345:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690469.321375:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690469.321398:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1779690469.321407:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492325504:0@lo:400:kworker.0 00000100:00100000:0.0:1779690469.321408:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492325248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690469.321420:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1779690469.321441:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1779690469.321443:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690469.321465:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aeae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492326144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690469.321466:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492326016:0@lo:400:kworker.0 00002000:00000024:0.0:1779690469.321487:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742588416 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690469.321517:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aeae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492326144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690469.321522:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1779690469.321578:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690469.321629:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325376 00000100:00100000:3.0:1779690469.321633:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325376 00000100:00100000:3.0:1779690469.321670:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1779690469.321678:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492325376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.321723:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492325376:12345-0@lo:400:kworker.0 Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690469.321738:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1779690469.321741:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325760 00000100:00100000:0.0:1779690469.321746:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325760 00000100:00100000:0.0:1779690469.321773:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325888 00000100:00100000:0.0:1779690469.321776:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325888 00000100:00100000:3.0:1779690469.321782:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:3.0:1779690469.321794:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690469.321799:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:0.0:1779690469.321834:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690469.321876:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492325888:12345-0@lo:400:kworker.0 Request processed in 46us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690469.321890:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492325760:12345-0@lo:400:kworker.0 Request processed in 97us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690469.321897:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:3.0:1779690469.321904:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00080000:0.0:1779690469.321918:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690469.321922:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690469.321930:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325632 00000100:00100000:3.0:1779690469.321935:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325632 00000100:00080000:0.0:1779690469.321959:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690469.321971:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492325504 00000100:00100000:0.0:1779690469.321974:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492326016 00000100:00100000:3.0:1779690469.321975:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492325504 00000100:00100000:0.0:1779690469.321980:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492326016 00000100:00100000:3.0:1779690469.322017:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1779690469.322026:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492325632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.322073:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492325632:12345-0@lo:400:kworker.0 Request processed in 49us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690469.322295:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1779690469.322305:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492326016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690469.322338:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492326016:12345-0@lo:400:kworker.0 Request processed in 36us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690469.326336:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1779690469.326426:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1779690469.326442:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492325504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326526:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492325504:12345-0@lo:400:kworker.0 Request processed in 91us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690469.326533:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1779690469.326562:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690469.326600:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492325760:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326638:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492325504:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326650:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492326016:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326674:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bb060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492325376:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326685:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492325888:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326717:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492325632:0@lo:400:kworker.0 00000100:00100000:3.0:1779690469.326733:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492326144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690469.326743:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492325248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690469.327127:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00010000:0.0:1779690469.834387:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690469.891375:0:67394:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690469.891383:0:67394:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690469.892947:0:67394:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690469.892959:0:67394:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000020:00000080:0.0:1779690470.569099:0:67442:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffea3353620 00000004:00000080:0.0:1779690470.569115:0:67442:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e2f81971800 uarg=0000000000000000 00000004:00000080:0.0:1779690470.569253:0:67442:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e2f81971800 00000040:00080000:0.0:1779690470.569634:0:67442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].7, 80 off8752 00000004:00000080:0.0:1779690470.569659:0:67442:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl7', mask 0x0 00000004:02000000:0.0:1779690470.569662:0:67442:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690470.667778:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690470.667865:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664768 00000100:00100000:0.0:1779690470.667875:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664768 00000100:00080000:1.0:1779690470.667948:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690470.667964:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 643 00000100:00100000:0.0:1779690470.667975:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+44:105490:x1866137503664768:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690470.667995:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690470.668015:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ef12 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddc0 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668098:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668112:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668124:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668151:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668159:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668165:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668645:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668654:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668662:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690470.668692:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00000004:00200000:0.0:1779690470.668696:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690470.668713:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668732:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668741:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668747:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668752:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668758:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690470.668761:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668768:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668779:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:0.0:1779690470.668782:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690470.668787:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668792:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef19 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668802:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668827:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668838:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668844:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690470.668847:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668853:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668862:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690470.668865:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690470.668868:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668874:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef20 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668907:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ef12 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668920:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.668927:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690470.668929:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690470.668931:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e000, rc 0) 00000100:00100000:0.0:1779690470.668997:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+45:105490:x1866137503664768:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1024us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690470.669014:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 643 00000100:00100000:1.0:1779690470.674583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690470.674913:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503664896 00000100:00100000:0.0:1779690470.674924:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503664896 00000100:00100000:0.0:1779690470.675915:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6423 00000100:00100000:0.0:1779690470.675927:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503664896:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690470.675942:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690470.675959:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c0a0dec/0xb4bb873a1913ef2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddc7 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690470.676013:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492326272:192.168.203.5@tcp:106: 00000100:00100000:0.0:1779690470.676110:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8face180 going to sleep for 11 seconds 00000100:00080000:1.0:1779690470.678844:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1779690470.687602:0:22279:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1779690470.687616:0:22279:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb mtime: 0 -> 1779690468 00002000:00010000:2.0:1779690470.687619:0:22279:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb atime: 0 -> 1779690468 00002000:00010000:2.0:1779690470.687621:0:22279:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb ctime: 0 -> 1779690468 00000100:00100000:2.0:1779690470.687645:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492326272:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690470.687693:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c0a0dec/0xb4bb873a1913ef2e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc7 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.687717:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c0a0dec/0xb4bb873a1913ef2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc7 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.687728:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:2.0:1779690470.687782:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503664896:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 11858us (13208us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690470.687791:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6423 00000100:00100000:1.0:1779690470.690329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.690357:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665024 00000100:00100000:1.0:1779690470.690366:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665024 00000100:00100000:1.0:1779690470.690414:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 644 00000100:00100000:1.0:1779690470.690432:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+45:105490:x1866137503665024:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690470.690451:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690470.690484:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ef35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddce expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690548:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690562:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690573:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690470.690624:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x84:0x0]: returning size 512 00000004:00200000:1.0:1779690470.690628:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690470.690648:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690684:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913ef35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690700:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.690708:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:1.0:1779690470.690711:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690470.690714:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690470.690761:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:105490:x1866137503665024:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 330us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690470.690777:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 644 00000100:00100000:3.0:1779690470.695187:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690470.695215:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665152 00000100:00100000:3.0:1779690470.695222:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665152 00000100:00100000:3.0:1779690470.695262:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6424 00000100:00100000:3.0:1779690470.695271:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503665152:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690470.695286:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690470.695301:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086500ad7/0xb4bb873a1913ef43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddd5 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690470.695352:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492326400:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690470.695423:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f96d5d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690470.704578:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492326400:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690470.704625:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086500ad7/0xb4bb873a1913ef43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddd5 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.704649:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086500ad7/0xb4bb873a1913ef43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddd5 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.704674:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266a00, rc 0) 00000100:00100000:3.0:1779690470.704734:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503665152:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 9463us (9554us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690470.704742:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6424 00000100:00100000:3.0:1779690470.708179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.708577:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665408 00000100:00100000:2.0:1779690470.708586:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665408 00000100:00100000:2.0:1779690470.708648:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 645 00000100:00100000:2.0:1779690470.708658:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+46:105490:x1866137503665408:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690470.709118:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].28, 136 off12000 00000100:00100000:2.0:1779690470.709210:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+46:105490:x1866137503665408:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 553us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690470.709219:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 645 00010000:00010000:2.0:1779690470.856898:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690470.857009:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690470.857016:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690470.857066:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 29 count 9 00000040:00080000:3.0:1779690470.857072:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690470.859740:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43fad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492326528:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690470.859862:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088c59240 going to sleep for 11 seconds 00000100:00100000:2.0:1779690470.862663:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43fad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492326528:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690470.866824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.866907:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665536 00000100:00100000:2.0:1779690470.866915:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665536 00000100:00100000:2.0:1779690470.866971:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 646 00000100:00100000:2.0:1779690470.866980:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+44:105500:x1866137503665536:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690470.867010:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690470.867101:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+44:105500:x1866137503665536:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690470.867109:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 646 00000100:00080000:0.0:1779690470.867218:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690470.869008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690470.869073:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665792 00000100:00100000:0.0:1779690470.869079:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665792 00000100:00100000:0.0:1779690470.869117:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 647 00000100:00100000:0.0:1779690470.869124:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+44:105500:x1866137503665792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690470.869140:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690470.869157:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedddc expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.869233:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef51 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.869246:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.869266:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690470.869286:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00010000:00010000:0.0:1779690470.869394:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ef4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedddc expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.869408:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedddc expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.869417:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690470.869420:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690470.869423:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e800, rc 0) 00000100:00100000:0.0:1779690470.869471:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+46:105500:x1866137503665792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 347us (467us total) trans 12884902189 rc 0/0 00000100:00100000:0.0:1779690470.869478:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 647 00000100:00100000:2.0:1779690470.881411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.881489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.882394:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666048 00000100:00100000:1.0:1779690470.882405:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666048 00000100:00100000:1.0:1779690470.882464:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18666 00000100:00100000:1.0:1779690470.882473:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+46:2389:x1866137503666048:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690470.882488:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690470.882510:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913ef51 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedddc expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.882525:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:1.0:1779690470.882530:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690470.882578:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+45:2389:x1866137503666048:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 105us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690470.882584:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18666 00000100:00100000:0.0:1779690470.886405:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503665920 00000100:00100000:0.0:1779690470.886417:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503665920 00000100:00100000:0.0:1779690470.886499:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6425 00000100:00100000:0.0:1779690470.886510:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503665920:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690470.886550:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.886570:0:49882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.886596:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690470.886598:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690470.886602:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.886637:0:49882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 8 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.886650:0:49882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 8 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690470.886664:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492326656:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690470.886749:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8facecc0 going to sleep for 11 seconds 00000100:00080000:2.0:1779690470.887019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690470.894726:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492326656:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690470.894754:0:49882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690470.896424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690470.896525:0:37918:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666176 00000100:00100000:0.0:1779690470.896533:0:37918:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666176 00002000:00100000:0.0:1779690470.896578:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1ec:0x0] (0->1515) req@ffff9e308678f480 x1866137503666176/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:706/0 lens 2008/0 e 0 to 0 dl 1779690481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690470.896590:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678f480 with x1866137503666176 ext(0->1515) 00010000:00010000:0.0:1779690470.896598:0:37918:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 9 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.896631:0:37918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 9 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690470.896639:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e308678f480 00000100:00100000:0.0:1779690470.896672:0:37918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1779690470.896682:0:37918:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503666176:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:0.0:1779690470.897662:0:37918:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503666176:12345-192.168.203.5@tcp:4:cp.0 Request processed in 979us (1240us total) trans 4294968344 rc 0/0 00000100:00100000:0.0:1779690470.897671:0:37918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00002000:00100000:0.0:1779690470.897678:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1ec:0x0] (0->1515) req@ffff9e308678f480 x1866137503666176/t4294968344(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:706/0 lens 2008/448 e 0 to 0 dl 1779690481 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690470.897687:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678f480 with x1866137503666176 ext(0->1515) 00010000:00010000:0.0:1779690470.897694:0:37918:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.897708:0:37918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690470.897715:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e308678f480 00000100:00100000:0.0:1779690470.900119:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690470.900521:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666304 00000100:00100000:3.0:1779690470.900530:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666304 00010000:00010000:3.0:1779690470.900560:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690470.900600:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3249 00000100:00100000:3.0:1779690470.900609:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503666304:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690470.900621:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690470.900640:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.900652:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.900672:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a83aa3c/0xb4bb873a1913ef0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddb9 expref: 11 pid: 49882 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.900701:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690470.900703:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690470.900708:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.900717:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.900750:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690470.900791:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503666304:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 183us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690470.900798:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3249 00010000:00010000:0.0:1779690470.900932:0:49882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.900942:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.900970:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.900979:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.900987:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.900995:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690470.900999:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.901008:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.901020:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690470.901028:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76a20c2/0xb4bb873a1913ef5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690470.901098:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503665920:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 14590us (19694us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690470.901118:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6425 00000100:00100000:0.0:1779690470.904319:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.904398:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666560 00000100:00100000:1.0:1779690470.904406:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666560 00000100:00100000:1.0:1779690470.904485:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 648 00000100:00100000:1.0:1779690470.904494:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:105500:x1866137503666560:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690470.904594:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+45:105500:x1866137503666560:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690470.904602:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 648 00000100:00100000:2.0:1779690470.911896:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690470.911959:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666688 00000100:00100000:3.0:1779690470.911969:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666688 00000100:00100000:3.0:1779690470.912012:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6426 00000100:00100000:3.0:1779690470.912020:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503666688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690470.912049:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690470.912067:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedde3 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690470.912095:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ec:0x0] initial LVB size: 1516, mtime: 0x6a13ebe4, atime: 0x0, ctime: 0x6a13ebe4, blocks: 0x1 00010000:00010000:3.0:1779690470.912113:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690470.912115:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690470.912123:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.912156:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.912169:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266e00, rc 0) 00000100:00100000:3.0:1779690470.912221:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503666688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690470.912227:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6426 00000100:00100000:3.0:1779690470.914558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.914800:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503666944 00000100:00100000:2.0:1779690470.914830:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503666944 00000100:00100000:2.0:1779690470.914882:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 649 00000100:00100000:2.0:1779690470.914890:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:105500:x1866137503666944:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690470.914984:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:105500:x1866137503666944:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690470.914992:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 649 00000100:00100000:2.0:1779690470.918372:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690470.918500:0:6586:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667072 00000100:00100000:0.0:1779690470.918509:0:6586:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667072 00002000:00100000:0.0:1779690470.918554:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1ec:0x0] (0->4095) req@ffff9e2f8f408700 x1866137503667072/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:706/0 lens 488/0 e 0 to 0 dl 1779690481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690470.918565:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f408700 with x1866137503667072 ext(0->4095) 00002000:00010000:0.0:1779690470.918571:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8f408700 00000100:00100000:0.0:1779690470.918607:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2049 00000100:00100000:0.0:1779690470.918617:0:6586:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503667072:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1779690470.919632:0:6586:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503667072:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 1013us (1266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1779690470.919642:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2049 00002000:00100000:1.0:1779690470.919651:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1ec:0x0] (0->4095) req@ffff9e2f8f408700 x1866137503667072/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:706/0 lens 488/4536 e 0 to 0 dl 1779690481 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690470.919671:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f408700 with x1866137503667072 ext(0->4095) 00002000:00010000:1.0:1779690470.919676:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8f408700 00000100:00100000:1.0:1779690470.923795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.923981:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667200 00000100:00100000:2.0:1779690470.923991:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667200 00000100:00100000:2.0:1779690470.924139:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 650 00000100:00100000:2.0:1779690470.924150:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+45:105500:x1866137503667200:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690470.924182:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690470.924200:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ef6d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddea expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924242:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924255:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924265:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924364:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913ef6d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 47 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924380:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.924388:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690470.924391:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690470.924395:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d800, rc 0) 00000100:00100000:2.0:1779690470.924457:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:105500:x1866137503667200:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 309us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690470.924465:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 650 00000100:00100000:3.0:1779690470.928006:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.928084:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667328 00000100:00100000:1.0:1779690470.928092:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667328 00000100:00100000:1.0:1779690470.928148:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 651 00000100:00100000:1.0:1779690470.928157:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:105500:x1866137503667328:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690470.928184:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690470.928287:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:105500:x1866137503667328:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690470.928294:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 651 00000100:00100000:3.0:1779690470.931489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.931606:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667456 00000100:00100000:1.0:1779690470.931615:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667456 00000100:00100000:1.0:1779690470.931668:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6427 00000100:00100000:1.0:1779690470.931678:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503667456:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690470.931717:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931733:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690470.931735:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690470.931741:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931754:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931802:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931844:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931851:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931857:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690470.931861:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931869:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931882:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.931890:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913ef7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690470.931955:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503667456:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 279us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690470.931971:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6427 00000100:00100000:2.0:1779690470.934754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.934843:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667712 00000100:00100000:1.0:1779690470.934849:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667712 00000100:00100000:1.0:1779690470.934887:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 652 00000100:00100000:1.0:1779690470.934894:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:105500:x1866137503667712:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690470.934956:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.934970:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.934978:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.935007:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690470.935018:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 46 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690470.935040:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492326784:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690470.935110:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8e8f6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690470.937936:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690470.938070:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492326784:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690470.938094:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690470.938249:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503667840 00000100:00100000:2.0:1779690470.938256:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503667840 00010000:00010000:2.0:1779690470.938285:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 47 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690470.938421:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3250 00000100:00100000:2.0:1779690470.938431:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503667840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690470.938445:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690470.938453:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 47 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938465:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 47 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938484:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913ef74 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddea expref: 47 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938497:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690470.938513:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938522:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938529:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690470.938557:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690470.938607:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+46:2391:x1866137503667840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690470.938614:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3250 00010000:00010000:3.0:1779690470.938664:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.938672:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690470.939702:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902190 00010000:00010000:3.0:1779690470.939731:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939740:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939747:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939752:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690470.939763:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939770:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939782:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690470.939785:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690470.939789:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690470.939795:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913ef82 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690470.939921:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:105500:x1866137503667712:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 5026us (5171us total) trans 12884902191 rc 0/0 00000100:00100000:3.0:1779690470.939930:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 652 00000020:00080000:3.0:1779690470.939935:0:57561:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1779690470.940102:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690470.940106:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690470.940782:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:3.0:1779690470.940790:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690470.943732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690470.943801:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668096 00000100:00100000:2.0:1779690470.943854:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668096 00000100:00100000:2.0:1779690470.943903:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:2.0:1779690470.943912:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+47:105500:x1866137503668096:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690470.944139:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+48:105500:x1866137503668096:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 226us (414us total) trans 12884902192 rc 0/0 00000100:00100000:2.0:1779690470.944147:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 90 00000040:00080000:0.0:1779690471.322848:0:67491:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690471.322857:0:67491:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690471.322924:0:67491:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 29 count 9 00000040:00080000:0.0:1779690471.322930:0:67491:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690471.379240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.380425:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668224 00000100:00100000:2.0:1779690471.380436:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668224 00000100:00100000:2.0:1779690471.380502:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6428 00000100:00100000:2.0:1779690471.380514:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503668224:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690471.380532:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690471.380551:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddf1 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.380577:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690471.380579:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690471.380587:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.380615:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.380630:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170ca00, rc 0) 00000100:00100000:2.0:1779690471.380694:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+18:2390:x1866137503668224:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 183us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.380701:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6428 00000100:00100000:3.0:1779690471.392936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.392976:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668480 00000100:00100000:3.0:1779690471.392985:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668480 00000100:00100000:3.0:1779690471.393406:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 653 00000100:00100000:3.0:1779690471.393419:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+46:105501:x1866137503668480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690471.393439:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690471.393467:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ef90 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddf8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.393565:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.393580:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.393592:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690471.393604:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00010000:00010000:3.0:1779690471.393726:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913ef90 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf8 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.393742:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf8 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.393752:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690471.393756:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690471.393760:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267a00, rc 0) 00000100:00100000:3.0:1779690471.393844:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:105501:x1866137503668480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 429us (918us total) trans 12884902193 rc 0/0 00000100:00100000:3.0:1779690471.393852:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 653 00000100:00100000:2.0:1779690471.401708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.401931:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668608 00000100:00100000:2.0:1779690471.401940:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668608 00000100:00100000:2.0:1779690471.401988:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6429 00000100:00100000:2.0:1779690471.401999:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503668608:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:2.0:1779690471.402159:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402179:0:40949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402188:0:40949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402195:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690471.402197:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690471.402201:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402232:0:40949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402245:0:40949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 18 pid: 22279 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.402258:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492326912:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690471.402451:0:40949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.402462:0:40949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 9 pid: 22747 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.402472:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93572d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492327040:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690471.402515:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8d540780 going to sleep for 11 seconds 00000100:00100000:3.0:1779690471.404580:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492326912:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690471.405585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.406264:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668736 00000100:00100000:2.0:1779690471.406274:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668736 00010000:00010000:2.0:1779690471.406307:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 19 pid: 22279 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.407727:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3251 00000100:00100000:2.0:1779690471.407741:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503668736:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690471.407759:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1779690471.407793:0:5779:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1779690471.407801:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 19 pid: 22279 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.407834:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 19 pid: 22279 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.407856:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddaa924/0xb4bb873a1913ef89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf1 expref: 19 pid: 22279 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.407885:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690471.407942:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503668736:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 206us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.407950:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3251 00000100:00100000:3.0:1779690471.409912:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93572d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492327040:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690471.409939:0:40949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.410035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.410149:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503668864 00000100:00100000:0.0:1779690471.410157:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503668864 00010000:00010000:0.0:1779690471.410187:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.410216:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3252 00000100:00100000:0.0:1779690471.410225:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503668864:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690471.410238:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690471.410257:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.410282:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.410303:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a567b9/0xb4bb873a1913ef66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedde3 expref: 10 pid: 22747 timeout: 3298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.411133:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690471.411136:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690471.411141:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.411154:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.411189:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690471.411234:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503668864:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1009us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.411242:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3252 00010000:00010000:1.0:1779690471.411432:0:40949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411448:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411486:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411495:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411503:0:40949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411510:0:40949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690471.411514:0:40949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411522:0:40949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411534:0:40949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.411542:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ed03aa4/0xb4bb873a1913efa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690471.411596:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503668608:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 9599us (9897us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690471.411604:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6429 00000100:00100000:1.0:1779690471.416594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.417024:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503669120 00000100:00100000:2.0:1779690471.417043:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503669120 00000100:00100000:2.0:1779690471.417090:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:2.0:1779690471.417100:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+48:105501:x1866137503669120:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1779690471.417158:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf8 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1779690471.417614:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902194 00000001:00080000:2.0:1779690471.418073:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902195 00010000:00010000:2.0:1779690471.418126:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418142:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 47 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418151:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 51 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418159:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418189:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 51 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418214:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 51 pid: 64445 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.418228:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93572d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492327168:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690471.418312:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 47 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.418321:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 47 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.418330:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492327296:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690471.418354:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690471.422256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.422281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.422304:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503669376 00000100:00100000:3.0:1779690471.422311:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503669376 00010000:00010000:3.0:1779690471.422353:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 48 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.422387:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503669248 00000100:00100000:3.0:1779690471.422391:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503669248 00010000:00010000:3.0:1779690471.422403:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 52 pid: 64445 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.422422:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3253 00000100:00100000:3.0:1779690471.422430:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+48:2389:x1866137503669376:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690471.422443:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1779690471.422444:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3254 00010000:00010000:3.0:1779690471.422448:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 48 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.422451:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:2392:x1866137503669248:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690471.422459:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690471.422460:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 48 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.422463:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 52 pid: 64445 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423429:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 52 pid: 64445 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423455:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690471.423461:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423470:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423589:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423609:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690471.423664:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:2392:x1866137503669248:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1212us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.423672:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3254 00010000:00010000:0.0:1779690471.423723:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ef27 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddc0 expref: 51 pid: 64445 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.423737:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93572d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492327168:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690471.423748:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913eef6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddab expref: 48 pid: 57559 timeout: 3298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.423758:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492327296:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690471.423777:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423965:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.423981:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.424097:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690471.424103:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690471.424132:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+47:2389:x1866137503669376:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1700us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.424150:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3253 00000001:00080000:0.0:1779690471.424270:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902196 00000001:00080000:0.0:1779690471.426929:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902197 00000001:00080000:0.0:1779690471.427141:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902198 00000100:00100000:0.0:1779690471.427235:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492327424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1779690471.427839:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690471.427871:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953dfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690471.428171:0:40938:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492327424 00000100:00100000:2.0:1779690471.428179:0:40938:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492327424 00000100:00100000:2.0:1779690471.428247:0:40938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453 00000100:00100000:2.0:1779690471.428256:0:40938:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492327424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690471.428357:0:40938:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492327424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.428363:0:40938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453 00000100:00100000:2.0:1779690471.428404:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492327424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1779690471.428948:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902199 00000100:00100000:2.0:1779690471.429013:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492327552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690471.429058:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690471.429092:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447b840 going to sleep for 11 seconds 00000100:00100000:1.0:1779690471.429173:0:6591:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492327552 00000100:00100000:1.0:1779690471.429179:0:6591:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492327552 00000100:00100000:1.0:1779690471.429260:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454 00000100:00100000:1.0:1779690471.429268:0:6591:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492327552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1779690471.429481:0:6591:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492327552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 212us (420us total) trans 4294968345 rc 0/0 00000100:00100000:1.0:1779690471.429488:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454 00000100:00080000:0.0:1779690471.429556:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690471.429788:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93571500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492327552:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:2.0:1779690471.429854:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429866:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429874:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429879:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690471.429883:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429892:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429907:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690471.429911:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1779690471.429916:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.429921:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913efac lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690471.430254:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x85:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1779690471.430750:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].8, 64 off8752 00000004:00080000:2.0:1779690471.430761:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3199004954997ns, next at 3200004952819ns, rc = 0 00000001:00080000:2.0:1779690471.430769:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902200 00010000:00010000:2.0:1779690471.430939:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690471.430949:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1779690471.430955:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913ef97 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddf8 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1779690471.431173:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902201 00000100:00100000:2.0:1779690471.431318:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:105501:x1866137503669120:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 14210us (14723us total) trans 12884902202 rc 0/0 00000100:00100000:2.0:1779690471.431328:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000020:00080000:2.0:1779690471.431333:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:1.0:1779690471.433416:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968344 is committed 00000100:00100000:3.0:1779690471.617915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.618143:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503669632 00000100:00100000:0.0:1779690471.618154:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503669632 00000100:00100000:0.0:1779690471.618225:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 654 00000100:00100000:0.0:1779690471.618235:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:105521:x1866137503669632:12345-192.168.203.5@tcp:101:md5sum.0 00010000:00010000:0.0:1779690471.618261:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690471.618283:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913efb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beddff expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618349:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618363:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618375:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618389:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618415:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618423:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618544:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913efc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618553:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913efc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618560:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913efc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690471.618569:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00010000:00010000:0.0:1779690471.618659:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618667:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618674:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618679:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690471.618683:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618690:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618713:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:0.0:1779690471.618716:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690471.618720:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618726:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913efba lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618741:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618746:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618751:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618756:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690471.618758:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618764:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618771:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0xab9f0aba (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690471.618773:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690471.618776:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618781:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913efc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618882:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913efb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x84:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddff expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618896:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913efc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddff expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.618903:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690471.618905:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690471.618907:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e400, rc 0) 00000100:00100000:0.0:1779690471.618970:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+57:105521:x1866137503669632:12345-192.168.203.5@tcp:101:md5sum.0 Request processed in 737us (1064us total) trans 12884902203 rc 0/0 00000100:00100000:0.0:1779690471.618978:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 654 00000100:00100000:0.0:1779690471.625173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690471.625399:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503669888 00000100:00100000:1.0:1779690471.625408:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503669888 00000100:00100000:1.0:1779690471.625479:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18667 00000100:00100000:1.0:1779690471.625488:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+57:105521:x1866137503669888:12345-192.168.203.5@tcp:103:md5sum.0 00010000:00010000:1.0:1779690471.625502:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690471.625525:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913efc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddff expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690471.625543:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f8be8ce00) 00010000:00010000:1.0:1779690471.625553:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690471.625711:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503669888:12345-192.168.203.5@tcp:103:md5sum.0 Request processed in 223us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690471.625719:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18667 00000100:00100000:2.0:1779690471.637591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.637686:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670016 00000100:00100000:3.0:1779690471.637696:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670016 00000100:00100000:3.0:1779690471.637751:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 655 00000100:00100000:3.0:1779690471.637762:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503670016:12345-192.168.203.5@tcp:58:md5sum.0 00010000:00010000:3.0:1779690471.637897:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.637914:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.637925:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1779690471.638263:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].29, 136 off12136 00000100:00100000:3.0:1779690471.638333:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503670016:12345-192.168.203.5@tcp:58:md5sum.0 Request processed in 572us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.638340:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 655 00000100:00100000:2.0:1779690471.643371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.643586:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670144 00000100:00100000:3.0:1779690471.643597:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670144 00000100:00100000:3.0:1779690471.643658:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 656 00000100:00100000:3.0:1779690471.643668:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503670144:12345-192.168.203.5@tcp:101:md5sum.0 00010000:00010000:3.0:1779690471.643687:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690471.643706:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede06 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643758:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643780:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 4/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643798:0:57559:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643829:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643843:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:3.0:1779690471.643846:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1779690471.643849:0:57559:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.643857:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266400, rc 0) 00000100:00100000:3.0:1779690471.644240:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+57:105521:x1866137503670144:12345-192.168.203.5@tcp:101:md5sum.0 Request processed in 572us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.644247:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 656 00000100:00100000:0.0:1779690471.874681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874770:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874831:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.874932:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670656 00000100:00100000:0.0:1779690471.874940:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670656 00000100:00100000:0.0:1779690471.874993:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670528 00000100:00100000:0.0:1779690471.874996:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670528 00000100:00100000:0.0:1779690471.875013:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670912 00000100:00100000:0.0:1779690471.875016:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670912 00000100:00100000:0.0:1779690471.875046:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671040 00000100:00100000:0.0:1779690471.875060:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671040 00000100:00100000:0.0:1779690471.875089:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2872 00000100:00100000:0.0:1779690471.875099:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503670656:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690471.875188:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503670656:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 89us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.875196:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2872 00000100:00100000:0.0:1779690471.875212:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2873 00000100:00100000:0.0:1779690471.875219:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503670528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690471.875250:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503670528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.875256:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2873 00000100:00100000:0.0:1779690471.875266:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2874 00000100:00100000:0.0:1779690471.875272:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503670912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690471.875294:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503670912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.875300:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2874 00000100:00100000:0.0:1779690471.875309:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2875 00000100:00100000:0.0:1779690471.875315:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503671040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690471.875336:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503671040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.875342:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2875 00000100:00080000:0.0:1779690471.875373:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690471.875396:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670400 00000100:00100000:0.0:1779690471.875400:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670400 00000100:00100000:0.0:1779690471.875438:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670784 00000100:00100000:0.0:1779690471.875441:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670784 00000100:00100000:0.0:1779690471.875463:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 184 00000100:00100000:0.0:1779690471.875471:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:2390:x1866137503670400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690471.875496:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00100000:2.0:1779690471.875508:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+57:2389:x1866137503670784:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690471.875529:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:2390:x1866137503670400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 58us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.875536:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 184 00000100:00100000:2.0:1779690471.875547:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+57:2389:x1866137503670784:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.875554:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00100000:3.0:1779690471.876000:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503670272 00000100:00100000:3.0:1779690471.876005:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503670272 00000100:00100000:3.0:1779690471.876078:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:3.0:1779690471.876086:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503670272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690471.876138:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503670272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.876144:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 161 00010000:00010000:3.0:1779690471.881685:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690471.945054:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690471.945063:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690471.945136:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 30 count 10 00000040:00080000:2.0:1779690471.945145:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690471.945254:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae655c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492327680:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690471.945499:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1779690471.952040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.952560:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671168 00000100:00100000:3.0:1779690471.952569:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671168 00000100:00100000:3.0:1779690471.952663:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 657 00000100:00100000:3.0:1779690471.952674:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671168:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690471.952704:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690471.952834:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671168:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 162us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.952842:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 657 00000100:00100000:2.0:1779690471.953151:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae655c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492327680:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690471.955698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.955789:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671296 00000100:00100000:2.0:1779690471.955798:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671296 00000100:00100000:2.0:1779690471.955863:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 658 00000100:00100000:2.0:1779690471.955872:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:105522:x1866137503671296:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690471.955949:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.955967:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.955978:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.955994:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956001:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956008:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956041:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956051:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956057:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690471.956091:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00000004:00200000:2.0:1779690471.956095:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690471.956106:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956117:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956130:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956148:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956155:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690471.956159:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956166:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956178:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690471.956181:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690471.956185:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956191:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913efe4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956202:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956208:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956213:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956217:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690471.956225:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956231:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956238:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4cebe047 (ffff9e2f826ec700) 00010000:00010000:2.0:1779690471.956241:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690471.956243:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956249:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913efeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4cebe047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956263:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956269:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956275:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956280:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690471.956283:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956288:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956294:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:2.0:1779690471.956297:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690471.956305:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.956311:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913eff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690471.956388:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:105522:x1866137503671296:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 516us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.956395:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 658 00000100:00100000:1.0:1779690471.959660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.959750:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671552 00000100:00100000:0.0:1779690471.959759:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671552 00000100:00100000:0.0:1779690471.959843:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 659 00000100:00100000:0.0:1779690471.959853:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:105522:x1866137503671552:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690471.959872:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690471.959890:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913eff9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede0d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.959976:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.959989:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960000:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690471.960009:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1b:0x0]: returning size 1516 00010000:00010000:0.0:1779690471.960108:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960141:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960148:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960154:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690471.960157:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960164:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960175:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:0.0:1779690471.960177:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690471.960182:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960187:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f000 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960223:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913eff9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede0d expref: 49 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960232:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690471.960235:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690471.960238:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913eff9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede0d expref: 49 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.960246:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e600, rc 0) 00000100:00100000:0.0:1779690471.960300:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671552:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 449us (648us total) trans 12884902204 rc 301/301 00000100:00100000:0.0:1779690471.960308:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 659 00000100:00100000:1.0:1779690471.965388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.965561:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671680 00000100:00100000:3.0:1779690471.965570:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671680 00000100:00100000:3.0:1779690471.965634:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 660 00000100:00100000:3.0:1779690471.965644:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671680:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690471.965676:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690471.965773:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671680:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.965780:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 660 00000100:00100000:2.0:1779690471.968587:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.968669:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503671936 00000100:00100000:0.0:1779690471.968677:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503671936 00000100:00100000:0.0:1779690471.968724:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 661 00000100:00100000:0.0:1779690471.968732:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:105522:x1866137503671936:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690471.968748:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690471.968766:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f00e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede14 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.969273:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f015 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.969287:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.969297:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690471.969306:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1c:0x0]: returning size 0 00010000:00010000:0.0:1779690471.969343:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f00e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede14 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.969374:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f015 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede14 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.969382:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690471.969384:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690471.969399:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ec00, rc 0) 00000100:00100000:0.0:1779690471.969448:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:105522:x1866137503671936:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 716us (867us total) trans 12884902205 rc 0/0 00000100:00100000:0.0:1779690471.969455:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 661 00000100:00100000:1.0:1779690471.972849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.972928:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672192 00000100:00100000:3.0:1779690471.972937:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672192 00000100:00100000:3.0:1779690471.972982:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 662 00000100:00100000:3.0:1779690471.972992:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:105522:x1866137503672192:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1779690471.973054:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690471.973078:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f015 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede14 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.973095:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:3.0:1779690471.973106:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690471.973150:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.973165:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.973174:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.973206:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.973220:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 56 pid: 57561 timeout: 3299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.973235:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ce13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492327808:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690471.973313:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690471.976689:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.976762:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672320 00000100:00100000:0.0:1779690471.976770:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672320 00010000:00010000:0.0:1779690471.976841:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 57 pid: 57561 timeout: 3299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.976881:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3255 00000100:00100000:0.0:1779690471.976890:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+57:2392:x1866137503672320:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690471.976903:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690471.976908:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 57 pid: 57561 timeout: 3299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.976920:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 57 pid: 57561 timeout: 3299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.976940:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:0.0:1779690471.976945:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.976954:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.976962:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.976980:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690471.977043:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+57:2392:x1866137503672320:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 154us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.977050:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3255 00010000:00010000:3.0:1779690471.977227:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913ef3c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x84:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beddce expref: 56 pid: 57561 timeout: 3299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.977243:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ce13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492327808:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690471.977261:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977269:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977274:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977358:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977367:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977374:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977442:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977449:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977456:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977462:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690471.977466:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977485:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977494:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x0 (ffff9e2f826ec000) 00010000:00010000:3.0:1779690471.977497:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690471.977501:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977507:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f023 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977523:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977530:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977536:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977542:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690471.977545:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977551:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977559:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x84:0x0].0x3f6a9bf2 (ffff9e2f905ad600) 00010000:00010000:3.0:1779690471.977561:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690471.977564:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.977570:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f02a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x84:0x0].0x3f6a9bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690471.977629:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:105522:x1866137503672192:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4638us (4826us total) trans 0 rc -2/-2 00000100:00100000:3.0:1779690471.977637:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 662 00000100:00100000:0.0:1779690471.979962:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.980046:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672448 00000100:00100000:2.0:1779690471.980053:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672448 00000100:00100000:2.0:1779690471.980099:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 663 00000100:00100000:2.0:1779690471.980108:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3091752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:105522:x1866137503672448:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690471.980125:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690471.980144:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f031 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede1b expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980173:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913f038 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980183:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913f038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980192:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913f038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980274:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f031 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede1b expref: 51 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980300:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d000/0xb4bb873a1913f038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede1b expref: 50 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690471.980308:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:2.0:1779690471.980310:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690471.980314:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d000, rc 0) 00000100:00100000:2.0:1779690471.980372:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3091752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:105522:x1866137503672448:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 265us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690471.980379:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 663 00000100:00100000:1.0:1779690471.984107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.984367:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672704 00000100:00100000:0.0:1779690471.984376:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672704 00000100:00100000:0.0:1779690471.984429:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 664 00000100:00100000:0.0:1779690471.984439:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:105522:x1866137503672704:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690471.984526:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.984544:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690471.984554:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690471.984973:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003790ffaf reply state 00000000a29e8d8b transno 12884902206 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690471.984985:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690471.985076:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:105522:x1866137503672704:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 638us (976us total) trans 12884902206 rc 0/0 00000100:00100000:0.0:1779690471.985084:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 664 00010000:00010000:3.0:1779690471.987434:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987464:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987471:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987487:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690471.987491:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987499:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987514:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:3.0:1779690471.987517:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690471.987522:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.987529:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f03f lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690471.989520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.989730:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672832 00000100:00100000:3.0:1779690471.989740:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672832 00000100:00100000:3.0:1779690471.989792:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 665 00000100:00100000:3.0:1779690471.989802:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+51:105522:x1866137503672832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690471.989857:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690471.989874:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f046 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede22 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.989944:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f046 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede22 expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.989957:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267400/0xb4bb873a1913f046 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede22 expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690471.989966:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:3.0:1779690471.989969:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1779690471.989972:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267400, rc 0) 00000100:00100000:3.0:1779690471.990035:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:105522:x1866137503672832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 235us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.990042:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 665 00000100:00100000:1.0:1779690471.992346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.992462:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503672960 00000100:00100000:3.0:1779690471.992470:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503672960 00000100:00100000:3.0:1779690471.992525:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1779690471.992534:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:105522:x1866137503672960:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1779690471.992637:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:105522:x1866137503672960:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690471.992645:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:1.0:1779690471.994932:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690471.995017:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503673216 00000100:00100000:3.0:1779690471.995033:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503673216 00000100:00100000:3.0:1779690471.995080:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:3.0:1779690471.995088:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:105522:x1866137503673216:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690471.995297:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+53:105522:x1866137503673216:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 209us (371us total) trans 12884902207 rc 0/0 00000100:00100000:3.0:1779690471.995316:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:1.0:1779690471.997250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690471.997349:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503673472 00000100:00100000:0.0:1779690471.997357:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503673472 00000100:00100000:0.0:1779690471.997402:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 666 00000100:00100000:0.0:1779690471.997410:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:105522:x1866137503673472:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690471.997718:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:105522:x1866137503673472:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 308us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690471.997735:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 666 00000100:00100000:1.0:1779690471.999864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690471.999953:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503673728 00000100:00100000:2.0:1779690471.999960:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503673728 00000100:00100000:2.0:1779690472.000008:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 667 00000100:00100000:2.0:1779690472.000016:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:105522:x1866137503673728:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690472.000085:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000101:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000113:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000463:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000482:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000500:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000506:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690472.000510:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000518:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000530:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:2.0:1779690472.000533:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690472.000539:0:57559:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000549:0:57559:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000558:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.000587:0:57559:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266400/0xb4bb873a1913efdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede06 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690472.000601:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae657800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492327936:192.168.203.5@tcp:105: 00000100:00100000:2.0:1779690472.000674:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690472.003668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690472.003843:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503673856 00000100:00100000:3.0:1779690472.003852:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503673856 00000100:00100000:3.0:1779690472.003913:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:3.0:1779690472.003923:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503673856:12345-192.168.203.5@tcp:49:md5sum.0 00000100:00100000:3.0:1779690472.004043:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503673856:12345-192.168.203.5@tcp:49:md5sum.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690472.004051:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:2.0:1779690472.004492:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae657800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492327936:192.168.203.5@tcp:105: 00010000:00010000:2.0:1779690472.004532:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004542:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913efd6 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004570:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004582:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004591:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004609:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004615:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004621:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004626:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690472.004630:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004636:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004646:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:2.0:1779690472.004654:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690472.004658:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004663:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f054 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004672:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004676:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004682:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004687:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690472.004689:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004694:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004702:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1b:0x0].0x0 (ffff9e2f905adf00) 00010000:00010000:2.0:1779690472.004704:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690472.004706:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.004711:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f04d lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690472.004902:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:105522:x1866137503673728:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 4886us (5043us total) trans 12884902208 rc 0/0 00000100:00100000:2.0:1779690472.004921:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 667 00000040:00080000:1.0:1779690472.005120:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690472.005125:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690472.005725:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:1.0:1779690472.005734:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00080000:0.0:1779690472.006555:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690472.009015:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690472.009155:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674112 00000100:00100000:3.0:1779690472.009165:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674112 00000100:00100000:3.0:1779690472.009228:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:3.0:1779690472.009238:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+54:105522:x1866137503674112:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00080000:0.0:1779690472.009455:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1779690472.012450:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x1c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1779690472.012721:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012739:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012750:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012757:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012763:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012769:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.012791:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690472.012912:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+55:105522:x1866137503674112:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 3671us (3901us total) trans 12884902209 rc 0/0 00000100:00100000:2.0:1779690472.012922:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00010000:00010000:0.0:1779690472.013002:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1779690472.013008:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690472.013015:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690472.013019:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690472.013035:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690472.013047:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1c:0x0].0x0 (ffff9e2f826ec700) 00010000:00010000:0.0:1779690472.013049:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1779690472.013055:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690472.013061:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f05b lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690472.013074:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690472.013076:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690472.013078:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690472.016849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690472.016930:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674368 00000100:00100000:2.0:1779690472.016940:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674368 00000100:00100000:2.0:1779690472.016985:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:2.0:1779690472.016994:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:105521:x1866137503674368:12345-192.168.203.5@tcp:35:md5sum.0 00000100:00100000:2.0:1779690472.017219:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+57:105521:x1866137503674368:12345-192.168.203.5@tcp:35:md5sum.0 Request processed in 225us (377us total) trans 12884902210 rc 0/0 00000100:00100000:2.0:1779690472.017237:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00000040:00080000:3.0:1779690472.644217:0:67543:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690472.644225:0:67543:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690472.644294:0:67543:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 30 count 10 00000040:00080000:3.0:1779690472.644300:0:67543:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690472.720414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690472.720496:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674496 00000100:00100000:2.0:1779690472.720515:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674496 00000100:00100000:2.0:1779690472.720573:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 668 00000100:00100000:2.0:1779690472.720585:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674496:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690472.720757:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674496:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690472.720765:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 668 00000100:00100000:1.0:1779690472.724417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690472.724599:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674624 00000100:00100000:0.0:1779690472.724608:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674624 00000100:00100000:0.0:1779690472.724668:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 669 00000100:00100000:0.0:1779690472.724678:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674624:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690472.724884:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690472.724959:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674624:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 282us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690472.724967:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 669 00000100:00100000:3.0:1779690472.734603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690472.734730:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674752 00000100:00100000:0.0:1779690472.734740:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674752 00000100:00100000:0.0:1779690472.734801:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 670 00000100:00100000:0.0:1779690472.734832:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690472.734980:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690472.735094:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674752:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 263us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690472.735102:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 670 00000100:00100000:1.0:1779690472.737694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690472.737751:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503674880 00000100:00100000:0.0:1779690472.737770:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503674880 00000100:00100000:0.0:1779690472.738107:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 671 00000100:00100000:0.0:1779690472.738118:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690472.738262:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690472.738356:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503674880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 241us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690472.738365:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 671 00000100:00100000:1.0:1779690472.753536:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690472.753618:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675008 00000100:00100000:0.0:1779690472.753628:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675008 00000100:00100000:0.0:1779690472.753686:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 672 00000100:00100000:0.0:1779690472.753696:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675008:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690472.753839:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675008:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690472.753848:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 672 00000100:00100000:0.0:1779690472.765304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690472.765380:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675136 00000100:00100000:1.0:1779690472.765389:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675136 00000100:00100000:1.0:1779690472.765447:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 673 00000100:00100000:1.0:1779690472.765457:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675136:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690472.765624:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675136:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 167us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690472.765633:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 673 00000100:00100000:3.0:1779690472.778973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690472.779045:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675264 00000100:00100000:1.0:1779690472.779061:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675264 00000100:00100000:1.0:1779690472.779114:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 674 00000100:00100000:1.0:1779690472.779132:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675264:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690472.779311:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675264:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 188us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690472.779320:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 674 00000100:00100000:1.0:1779690472.781874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690472.781945:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675392 00000100:00100000:2.0:1779690472.781953:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675392 00000100:00100000:2.0:1779690472.782001:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 675 00000100:00100000:2.0:1779690472.782009:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675392:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690472.782197:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:105537:x1866137503675392:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690472.782204:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 675 00010000:00010000:2.0:1779690472.907493:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690472.962108:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902206 is committed 00000001:00080000:2.0:1779690472.962128:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902203 is committed 00000001:00080000:2.0:1779690472.962204:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902210 is committed 00000001:00080000:2.0:1779690472.962210:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902208 is committed 00000004:00080000:2.0:1779690472.962216:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1779690472.962233:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f9447b780 refcount 2 committed 0 result 0 batchid 8590018967 00000020:00080000:2.0:1779690472.962238:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e30b460ab00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f9447b300 00000020:00080000:2.0:1779690472.962241:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e30b460ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e30ae887400 00000001:00080000:2.0:1779690472.962273:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902209 is committed 00000020:00080000:0.0:1779690472.962406:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018967 committed batchid 8590018966 00000020:00080000:0.0:1779690472.962654:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018966 00000100:00100000:0.0:1779690472.964318:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690472.964339:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492328064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1779690472.964410:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690472.964575:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328064 00000100:00100000:3.0:1779690472.964583:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328064 00000100:00100000:3.0:1779690472.964643:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6430 00000100:00100000:3.0:1779690472.964652:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492328064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1779690472.964676:0:40949:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:492 count 1 00002000:00010000:3.0:1779690472.964709:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ec:0x0] initial LVB size: 1516, mtime: 0x6a13ebe4, atime: 0x0, ctime: 0x6a13ebe4, blocks: 0xb 00010000:00010000:3.0:1779690472.964717:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690472.964744:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690472.964746:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690472.964752:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690472.964766:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690472.964776:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690472.964783:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690472.964836:0:40949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690472.964875:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690472.964881:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.964888:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690472.964891:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.964898:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.964911:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.964915:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690472.964930:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690472.964931:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690472.964932:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690472.966048:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3318:x1866137492328064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1393us (1634us total) trans 4294968346 rc 0/0 00000100:00100000:2.0:1779690472.966058:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6430 00000004:00080000:3.0:1779690472.966255:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f81e95f80/2, rc 0, transno 4294968346 00000100:00100000:3.0:1779690472.966262:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492328064:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1779690473.033732:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690473.033742:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690473.034081:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 30 count 9 00000040:00080000:1.0:1779690473.034090:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690473.930127:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690474.441194:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690474.441337:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690474.441693:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492328448:0@lo:400:kworker.0 00000100:00100000:0.0:1779690474.441731:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690474.441759:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492328960:0@lo:400:kworker.0 00000100:00100000:0.0:1779690474.441784:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690474.441820:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690474.441827:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492328576:0@lo:400:kworker.0 00000100:00100000:0.0:1779690474.441847:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690474.441875:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328448 00000100:00100000:3.0:1779690474.441880:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328192 00000100:00100000:0.0:1779690474.441882:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328448 00000100:00100000:3.0:1779690474.441883:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328192 00000100:00100000:3.0:1779690474.441919:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1779690474.441919:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1779690474.441927:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492328192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690474.441927:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492328448:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1779690474.441956:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690474.441972:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492328448:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690474.441978:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1779690474.441984:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492328192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690474.442018:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:3.0:1779690474.442054:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690474.442064:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328960 00000100:00100000:3.0:1779690474.442068:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328960 00000100:00100000:3.0:1779690474.442090:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328576 00000100:00100000:3.0:1779690474.442093:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328576 00000100:00100000:3.0:1779690474.442113:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1779690474.442119:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492328960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690474.442150:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492328960:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690474.442155:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1779690474.442166:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1779690474.442172:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492328576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690474.442194:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492328576:12345-0@lo:400:kworker.0 Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690474.442199:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1779690474.442212:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690474.442630:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492328704:0@lo:400:kworker.0 00000100:00100000:1.0:1779690474.442661:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690474.442701:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690474.442718:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1779690474.442724:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690474.442746:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690474.442761:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328832:0@lo:400:kworker.0 00000100:00100000:1.0:1779690474.442779:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690474.442801:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328704 00000100:00100000:3.0:1779690474.442802:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328320 00000100:00100000:3.0:1779690474.442819:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328320 00000100:00100000:1.0:1779690474.442819:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328704 00000100:00100000:0.0:1779690474.443191:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492328832 00000100:00100000:0.0:1779690474.443196:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492328832 00000100:00100000:0.0:1779690474.443222:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1779690474.443982:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1779690474.443991:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492328704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690474.444129:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492328704:12345-0@lo:400:kworker.0 Request processed in 139us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690474.444145:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1779690474.444205:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3320:x1866137492328832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690474.444302:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3320:x1866137492328832:12345-0@lo:400:kworker.0 Request processed in 1073us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690474.444318:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1779690474.444372:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328832:0@lo:400:kworker.0 00000100:00100000:0.0:1779690474.444383:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492328704:0@lo:400:kworker.0 00000100:00100000:2.0:1779690474.444627:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492328576:0@lo:400:kworker.0 00000100:00100000:2.0:1779690474.444638:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492328448:0@lo:400:kworker.0 00000100:00100000:2.0:1779690474.444654:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492328960:0@lo:400:kworker.0 00000100:00100000:3.0:1779690474.445880:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1779690474.445893:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1866137492328320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690474.445923:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690474.445976:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1866137492328320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690474.445983:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:1.0:1779690474.448332:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690474.448342:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690474.449208:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492328320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690474.953696:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690475.977560:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690476.553051:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968345 is committed 00000001:00080000:1.0:1779690476.553067:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968346 is committed 00000040:00080000:1.0:1779690476.979671:0:67742:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690476.979677:0:67742:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690476.979717:0:67742:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 8 count 2 00000040:00080000:1.0:1779690476.979724:0:67742:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690476.994673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994744:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994759:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994792:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690476.994854:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675776 00000100:00100000:3.0:1779690476.994862:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675776 00000100:00100000:3.0:1779690476.994905:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676288 00000100:00100000:3.0:1779690476.994907:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676288 00000100:00100000:3.0:1779690476.994922:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675904 00000100:00100000:3.0:1779690476.994924:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675904 00000100:00100000:3.0:1779690476.994940:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676160 00000100:00100000:3.0:1779690476.994942:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676160 00000100:00100000:3.0:1779690476.994962:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2877 00000100:00100000:3.0:1779690476.994979:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503675776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690476.995038:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503675776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690476.995045:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2877 00000100:00100000:3.0:1779690476.995062:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2878 00000100:00100000:3.0:1779690476.995067:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503676288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690476.995087:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503676288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690476.995091:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2878 00000100:00100000:3.0:1779690476.995100:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2879 00000100:00100000:3.0:1779690476.995104:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503675904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690476.995122:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503675904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 17us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690476.995136:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2879 00000100:00100000:3.0:1779690476.995148:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2880 00000100:00100000:3.0:1779690476.995154:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503676160:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690476.995177:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503676160:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690476.995183:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2880 00000100:00100000:1.0:1779690476.996655:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675520 00000100:00100000:1.0:1779690476.996664:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675520 00000100:00100000:1.0:1779690476.996700:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:1.0:1779690476.996707:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503675520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690476.996742:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503675520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690476.996749:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:1.0:1779690476.996778:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676032 00000100:00100000:1.0:1779690476.996782:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676032 00000100:00100000:1.0:1779690476.996823:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503675648 00000100:00100000:1.0:1779690476.996827:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503675648 00000100:00100000:1.0:1779690476.996849:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:1.0:1779690476.996855:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:2392:x1866137503676032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690476.996885:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+44:2392:x1866137503676032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690476.996890:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:1.0:1779690476.996902:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00100000:1.0:1779690476.996908:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+42:2392:x1866137503675648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690476.996940:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+42:2392:x1866137503675648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690476.996946:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00080000:1.0:1779690476.996966:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690476.996980:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690476.996983:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1779690477.002909:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690477.030129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690477.030660:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676416 00000100:00100000:1.0:1779690477.030670:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676416 00000100:00100000:1.0:1779690477.030730:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 676 00000100:00100000:1.0:1779690477.030747:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:105981:x1866137503676416:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:1.0:1779690477.030791:0:64445:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b39aeeb0 uarg=0000000000000000 00000004:00000080:1.0:1779690477.030848:0:64445:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b39aeeb0 00000004:00000080:1.0:1779690477.030854:0:64445:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=7, endrec=0 00000040:00080000:1.0:1779690477.030945:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690477.030950:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690477.030995:0:64445:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl7 endrec = 29 00000040:00080000:1.0:1779690477.031081:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 8 count 2 00000040:00080000:1.0:1779690477.031088:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690477.031094:0:64445:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl7 entries up to 18446744073709551615 00000040:00080000:1.0:1779690477.031142:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690477.031145:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690477.032018:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 29 count 1 00000040:00080000:1.0:1779690477.032026:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1779690477.032113:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:105981:x1866137503676416:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1372us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690477.032123:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 676 00000020:00000080:0.0:1779690477.638372:0:67791:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffcd36e78b0 00000004:00000080:0.0:1779690477.638385:0:67791:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e30af768000 uarg=0000000000000000 00000004:00000080:0.0:1779690477.638421:0:67791:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e30af768000 00000004:00000080:0.0:1779690477.638428:0:67791:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=7, endrec=0 00000040:00080000:0.0:1779690477.638519:0:67791:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690477.638523:0:67791:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690477.638554:0:67791:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl7 endrec = 29 00000040:00080000:0.0:1779690477.638613:0:67791:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 8 count 2 00000040:00080000:0.0:1779690477.638619:0:67791:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690477.638652:0:67791:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl7 entries up to 18446744073709551615 00000040:00080000:0.0:1779690477.638696:0:67791:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690477.638699:0:67791:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690477.639347:0:67791:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:0.0:1779690477.639354:0:67791:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:0.0:1779690477.639376:0:67791:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=7 00000040:00080000:0.0:1779690477.639421:0:67791:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690477.639424:0:67791:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690477.639638:0:67791:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 7 count 1 00000040:00080000:0.0:1779690477.639643:0:67791:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690477.639661:0:67791:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1779690477.639667:0:67791:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:0.0:1779690477.639670:0:67791:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl7 record=18446744073709551615 00000040:00080000:0.0:1779690477.639711:0:67791:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690477.639714:0:67791:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690477.640367:0:67791:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:0.0:1779690477.640374:0:67791:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:0.0:1779690477.640437:0:67791:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690477.640441:0:67791:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690477.641105:0:67791:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690477.641112:0:67791:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690478.028798:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1779690478.084235:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018967 batchid updated 00000020:00080000:0.0:1779690478.084376:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018967 00000020:00080000:0.0:1779690478.084390:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018967 00000040:00080000:2.0:1779690478.437063:0:67841:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690478.437076:0:67841:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690478.438278:0:67841:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690478.438294:0:67841:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690478.526311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690478.526405:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676544 00000100:00100000:1.0:1779690478.526617:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676544 00000100:00100000:1.0:1779690478.526769:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 677 00000100:00100000:1.0:1779690478.526782:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+42:105445:x1866137503676544:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1779690478.526914:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+42:105445:x1866137503676544:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 135us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690478.526921:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 677 00000100:00080000:0.0:1779690478.529670:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690478.533246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690478.533428:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503676800 00000100:00100000:0.0:1779690478.533442:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503676800 00000100:00100000:0.0:1779690478.533506:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:0.0:1779690478.533518:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+42:105445:x1866137503676800:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690478.534145:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+43:105445:x1866137503676800:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 626us (905us total) trans 12884902211 rc 0/0 00000100:00100000:0.0:1779690478.534153:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00010000:00010000:0.0:1779690479.051172:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690479.561230:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690479.561273:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492329088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690479.561361:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690479.561458:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329088 00000100:00100000:0.0:1779690479.561468:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329088 00000100:00100000:0.0:1779690479.561532:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1779690479.561549:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492329088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690479.561594:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690479.561642:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492329088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690479.561650:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:0.0:1779690479.561675:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690479.561707:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968346 gen 2 00000004:00080000:0.0:1779690479.561714:0:3318:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968345 committed transno 4294968346 00000004:00080000:0.0:1779690479.561738:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f81e95f80, transno 4294968346 00000100:00100000:0.0:1779690479.561757:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492329088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690479.563055:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492329600:0@lo:400:kworker.0 00000100:00100000:3.0:1779690479.563116:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690479.563164:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690479.563170:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492329472:0@lo:400:kworker.0 00000100:00100000:3.0:1779690479.563201:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690479.563260:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329472 00000100:00100000:3.0:1779690479.563267:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329472 00000100:00100000:3.0:1779690479.563323:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1779690479.563332:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492329472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690479.563381:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492329472:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690479.563388:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1779690479.563502:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492329472:0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.563691:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492329216:0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.563741:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690479.563775:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492329728:0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.563800:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690479.563847:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1779690479.563854:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492329344:0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.563878:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690479.563896:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492329856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690479.563920:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690479.563957:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329600 00000100:00100000:0.0:1779690479.563961:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329600 00000100:00100000:0.0:1779690479.563999:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:0.0:1779690479.564005:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492329600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.564043:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492329600:12345-0@lo:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690479.564175:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:0.0:1779690479.564196:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329728 00000100:00100000:0.0:1779690479.564199:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329728 00000100:00100000:0.0:1779690479.564222:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329344 00000100:00100000:0.0:1779690479.564225:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329344 00000100:00100000:0.0:1779690479.564259:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1779690479.564265:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492329728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.564299:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492329728:12345-0@lo:400:kworker.0 Request processed in 35us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690479.564305:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1779690479.564317:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1779690479.564323:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492329344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.564349:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492329344:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690479.564354:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1779690479.564378:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329856 00000100:00100000:0.0:1779690479.564381:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329856 00000100:00100000:0.0:1779690479.564521:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1779690479.564528:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492329856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690479.564564:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620298240 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690479.564598:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492329856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690479.564604:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:0.0:1779690479.564630:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690479.564636:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690479.564667:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492329344:0@lo:400:kworker.0 00000100:00100000:1.0:1779690479.564857:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492329600:0@lo:400:kworker.0 00000100:00100000:0.0:1779690479.564915:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492329856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690479.564931:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492329728:0@lo:400:kworker.0 00000100:00100000:3.0:1779690479.565023:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492329216 00000100:00100000:3.0:1779690479.565031:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492329216 00000100:00100000:3.0:1779690479.565075:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1779690479.565082:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492329216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690479.565139:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492329216:12345-0@lo:400:kworker.0 Request processed in 57us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690479.565146:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1779690479.565513:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492329216:0@lo:400:kworker.0 00000001:02000400:1.0:1779690479.929639:0:67889:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 02:27:58 (1779690478) 00010000:00010000:0.0:1779690480.073259:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690480.142723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690480.144439:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677056 00000100:00100000:1.0:1779690480.144454:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677056 00000100:00100000:1.0:1779690480.144544:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 678 00000100:00100000:1.0:1779690480.144556:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+43:106183:x1866137503677056:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1779690480.144580:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690480.144582:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690480.144604:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f069 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede29 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144674:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144689:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144701:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144750:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144770:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.144778:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.145284:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f07e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.145295:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f07e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.145304:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f07e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690480.145868:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690480.146048:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146061:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146069:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146074:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690480.146079:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146086:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146097:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690480.146105:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.146111:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146117:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f070 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146130:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146136:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146142:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146146:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690480.146149:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146155:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146163:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f903c9000) 00010000:00010000:0.0:1779690480.146165:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.146167:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146173:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f077 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146518:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f069 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede29 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146545:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f07e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede29 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.146562:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690480.146565:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.146568:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fe00, rc 0) 00000100:00100000:0.0:1779690480.146634:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+45:106183:x1866137503677056:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2081us (3926us total) trans 12884902212 rc 0/0 00000100:00100000:0.0:1779690480.146651:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 678 00000100:00100000:3.0:1779690480.149185:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690480.149609:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677184 00000100:00100000:0.0:1779690480.149621:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677184 00000100:00100000:0.0:1779690480.149699:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18668 00000100:00100000:0.0:1779690480.149709:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+45:2390:x1866137503677184:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690480.149725:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690480.149746:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f07e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede29 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.149763:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690480.149768:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690480.149850:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+44:2390:x1866137503677184:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 142us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690480.149858:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18668 00000100:00100000:3.0:1779690480.149892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690480.149963:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677312 00000100:00100000:2.0:1779690480.149969:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677312 00000100:00100000:2.0:1779690480.150012:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 679 00000100:00100000:2.0:1779690480.150021:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f91331450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+44:106183:x1866137503677312:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690480.150088:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f91331450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+44:106183:x1866137503677312:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690480.150095:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 679 00000100:00100000:1.0:1779690480.167870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690480.167957:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677440 00000100:00100000:0.0:1779690480.167966:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677440 00000100:00100000:0.0:1779690480.168052:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 680 00000100:00100000:0.0:1779690480.168079:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+44:106184:x1866137503677440:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690480.168099:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690480.168118:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f08c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede30 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168171:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168186:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168197:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168209:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168216:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168222:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168469:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168477:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168483:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168498:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690480.168502:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168509:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168521:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:0.0:1779690480.168524:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.168529:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168534:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f093 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168547:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.168552:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690480.168627:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690480.169929:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.169935:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690480.169949:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.169957:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.169984:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690480.169987:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.169990:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.169997:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f09a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.170457:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f08c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede30 expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.170468:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:0.0:1779690480.170471:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690480.170475:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f08c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede30 expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.170484:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fe00, rc 0) 00000100:00100000:0.0:1779690480.171434:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+44:106184:x1866137503677440:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2475us (2690us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690480.171446:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 680 00000100:00100000:3.0:1779690480.175217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690480.176056:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677696 00000100:00100000:0.0:1779690480.176073:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677696 00000100:00100000:0.0:1779690480.176125:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 681 00000100:00100000:0.0:1779690480.176135:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+44:106184:x1866137503677696:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690480.176190:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690480.176214:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913ee2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd6c expref: 44 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.176250:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:0.0:1779690480.176255:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690480.176532:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.176547:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.176567:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.176600:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690480.176615:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 43 pid: 57585 timeout: 3307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690480.176629:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492329984:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690480.177177:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690480.189874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690480.190017:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677824 00000100:00100000:3.0:1779690480.190026:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677824 00010000:00010000:3.0:1779690480.190070:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 44 pid: 57585 timeout: 3307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690480.190106:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3256 00000100:00100000:3.0:1779690480.190116:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+44:2391:x1866137503677824:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690480.190130:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690480.190136:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 44 pid: 57585 timeout: 3307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690480.190148:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 44 pid: 57585 timeout: 3307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690480.190169:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:3.0:1779690480.190174:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690480.190183:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690480.190206:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690480.190223:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690480.190319:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+44:2391:x1866137503677824:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 204us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690480.190326:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3256 00010000:00010000:0.0:1779690480.192823:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913ee6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedd81 expref: 43 pid: 57585 timeout: 3307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690480.192845:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492329984:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690480.192865:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.196475:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.196490:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.196521:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.196534:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.196544:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690480.199444:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 512 00010000:00010000:1.0:1779690480.199459:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199469:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199477:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199494:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690480.199498:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199506:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199520:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad500) 00010000:00010000:1.0:1779690480.199523:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690480.199528:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.199533:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f0a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690480.199552:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cf0cca70 reply state 000000000cf09c58 transno 12884902213 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690480.199572:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690480.199792:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+45:106184:x1866137503677696:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 23654us (24576us total) trans 12884902213 rc 0/0 00000100:00100000:1.0:1779690480.199801:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 681 00000040:00080000:2.0:1779690480.200996:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690480.201001:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690480.202006:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:2.0:1779690480.202015:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690480.202203:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202213:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202220:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202239:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690480.202243:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202249:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202264:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (ffff9e2f903c9400) 00010000:00010000:1.0:1779690480.202266:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690480.202271:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690480.202277:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f0a8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690481.097131:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690482.118577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118744:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690482.118773:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690482.118992:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678208 00000100:00100000:2.0:1779690482.119005:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678208 00000100:00100000:2.0:1779690482.119800:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678336 00000100:00100000:2.0:1779690482.119828:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678336 00000100:00100000:2.0:1779690482.119856:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678720 00000100:00100000:2.0:1779690482.119859:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678720 00000100:00100000:2.0:1779690482.119879:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678592 00000100:00100000:2.0:1779690482.119882:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678592 00000100:00100000:2.0:1779690482.119908:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2882 00000100:00100000:2.0:1779690482.119938:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503678208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1779690482.120014:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690482.120019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690482.120038:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503678208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 102us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690482.120039:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2883 00000100:00100000:2.0:1779690482.120051:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2882 00000100:00100000:0.0:1779690482.120055:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503678336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690482.120077:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2884 00000100:00100000:2.0:1779690482.120086:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503678720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690482.120097:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503678336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690482.120105:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2883 00000100:00100000:0.0:1779690482.120121:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2885 00000100:00100000:0.0:1779690482.120128:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503678592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690482.120645:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503677952 00000100:00100000:3.0:1779690482.120651:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503677952 00000100:00100000:3.0:1779690482.120693:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:3.0:1779690482.120701:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503677952:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690482.120762:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503678720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 677us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690482.120770:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2884 00000100:00100000:2.0:1779690482.120797:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678080 00000100:00100000:2.0:1779690482.120801:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678080 00000100:00100000:2.0:1779690482.120865:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678464 00000100:00100000:2.0:1779690482.120869:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678464 00000100:00100000:2.0:1779690482.120892:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:2.0:1779690482.120898:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+43:2391:x1866137503678080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1779690482.124464:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690482.124518:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:1.0:1779690482.124543:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+44:2392:x1866137503678464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690482.124784:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503678592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4652us (6005us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690482.124785:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503677952:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4079us (6217us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690482.124799:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:0.0:1779690482.124907:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2885 00000100:00100000:2.0:1779690482.127020:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+43:2391:x1866137503678080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6108us (8342us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690482.127037:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:1.0:1779690482.127447:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+44:2392:x1866137503678464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2913us (8734us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690482.127457:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 195 00010000:00010000:1.0:1779690482.127946:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690482.717012:0:67986:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690482.717021:0:67986:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690482.717561:0:67986:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690482.717569:0:67986:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690483.146540:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690483.179110:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902212 is committed 00000001:00080000:2.0:1779690483.179134:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902213 is committed 00000040:00080000:0.0:1779690483.273981:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690483.273991:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690483.274027:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 30 count 9 00000040:00080000:0.0:1779690483.274033:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000020:00000080:3.0:1779690483.320897:0:68038:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007fff9e5cc580 00000004:00000080:3.0:1779690483.320923:0:68038:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e3084137c00 uarg=0000000000000000 00000004:00000080:3.0:1779690483.321439:0:68038:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e3084137c00 00000040:00080000:3.0:1779690483.322532:0:68038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].8, 80 off8832 00000004:00000080:3.0:1779690483.322663:0:68038:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl8', mask 0x0 00000004:02000000:3.0:1779690483.322668:0:68038:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:0.0:1779690483.592672:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690483.592753:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503678848 00000100:00100000:1.0:1779690483.592764:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503678848 00000100:00100000:1.0:1779690483.592846:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 682 00000100:00100000:1.0:1779690483.592857:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+43:106257:x1866137503678848:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690483.592877:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690483.592920:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede37 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.592985:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.592999:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.593011:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690483.593466:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690483.593472:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 107 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690483.594216:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.594249:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede37 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.594275:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede37 expref: 44 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.594284:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9400) 00010000:00010000:2.0:1779690483.594287:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690483.594290:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:2.0:1779690483.594344:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+44:106257:x1866137503678848:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1489us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.594353:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 682 00000100:00100000:0.0:1779690483.605821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690483.605864:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503679104 00000100:00100000:3.0:1779690483.605873:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503679104 00000100:00100000:3.0:1779690483.605947:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 683 00000100:00100000:3.0:1779690483.605970:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+44:106257:x1866137503679104:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:3.0:1779690483.606024:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690483.606052:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f0b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede37 expref: 44 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.606071:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9400) 00010000:00010000:3.0:1779690483.606082:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690483.607042:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+43:106257:x1866137503679104:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 1073us (1241us total) trans 0 rc -17/-17 00000100:00100000:3.0:1779690483.607052:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 683 00000100:00100000:1.0:1779690483.610870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.610989:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503679232 00000100:00100000:2.0:1779690483.610999:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503679232 00000100:00100000:2.0:1779690483.611051:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 684 00000100:00100000:2.0:1779690483.611073:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+43:106257:x1866137503679232:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690483.611094:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690483.611114:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f0bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede3e expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611177:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611190:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611201:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690483.611390:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690483.611399:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 107 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690483.611479:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611505:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f0bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede3e expref: 45 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611740:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede3e expref: 44 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.611749:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690483.611752:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690483.611756:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690483.611844:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+44:106257:x1866137503679232:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 774us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.611852:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 684 00000100:00100000:0.0:1779690483.615717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.615790:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503679360 00000100:00100000:2.0:1779690483.615801:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503679360 00000100:00100000:2.0:1779690483.615882:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 685 00000100:00100000:2.0:1779690483.615893:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+44:106257:x1866137503679360:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690483.615923:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690483.615943:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f0cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede45 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616004:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616018:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616047:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616074:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616082:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616089:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616423:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616432:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616440:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690483.616545:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 7680 00000004:00200000:2.0:1779690483.616549:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690483.616619:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616632:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616639:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616654:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616660:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690483.616664:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616671:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616682:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690483.616685:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690483.616689:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616694:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f0d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616705:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616712:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616717:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616721:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690483.616723:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616737:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616744:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (ffff9e2f826ec900) 00010000:00010000:2.0:1779690483.616747:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690483.616749:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616755:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f0d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616784:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f0cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede45 expref: 46 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616797:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede45 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.616829:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690483.616831:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690483.616834:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170de00, rc 0) 00000100:00100000:2.0:1779690483.616897:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+45:106257:x1866137503679360:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1006us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.616916:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 685 00000100:00100000:1.0:1779690483.686014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690483.686236:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503679488 00000100:00100000:3.0:1779690483.686245:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503679488 00000100:00100000:3.0:1779690483.686302:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 686 00000100:00100000:3.0:1779690483.686312:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+41:106263:x1866137503679488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690483.686331:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690483.686350:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede4c expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686414:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686428:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686440:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690483.686651:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690483.686660:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 107 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690483.686731:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686756:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 43 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686772:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 42 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.686781:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690483.686784:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690483.686788:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267800, rc 0) 00000100:00100000:3.0:1779690483.686914:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+42:106263:x1866137503679488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 603us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690483.686921:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 686 00000100:00100000:3.0:1779690483.692764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690483.692892:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503679744 00000100:00100000:0.0:1779690483.692928:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503679744 00000100:00100000:0.0:1779690483.692990:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 687 00000100:00100000:0.0:1779690483.693001:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+45:106263:x1866137503679744:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690483.693021:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690483.693024:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1779690483.693050:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f0e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede45 expref: 45 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693068:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:0.0:1779690483.693090:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690483.693106:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f0f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede53 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693636:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693651:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693661:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693673:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693678:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.693684:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695864:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695882:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695895:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690483.695915:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 0 00010000:00010000:0.0:1779690483.695942:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695949:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695956:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695961:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690483.695966:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695973:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.695984:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690483.695987:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690483.695991:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.696010:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f0fc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690483.696026:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a141bf91 reply state 0000000060226512 transno 12884902214 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690483.696035:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690483.696072:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f0f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.696201:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.696209:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690483.696211:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690483.696214:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690483.696345:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+47:106263:x1866137503679744:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3345us (3589us total) trans 12884902214 rc 0/0 00000100:00100000:0.0:1779690483.696354:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 687 00010000:00010000:3.0:1779690483.700645:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700667:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700676:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700683:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690483.700688:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700719:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700741:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0xfd36da02 (ffff9e2f8be8c100) 00010000:00010000:3.0:1779690483.700743:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690483.700749:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.700756:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f103 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690483.703067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690483.703250:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503680000 00000100:00100000:1.0:1779690483.703260:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503680000 00000100:00100000:1.0:1779690483.703315:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 688 00000100:00100000:1.0:1779690483.703325:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:106263:x1866137503680000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690483.703360:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690483.703389:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f118 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede5a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.703499:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.703514:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.703523:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.703574:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.703587:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 47 pid: 57560 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690483.703613:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492330112:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690483.703709:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3088260540 going to sleep for 11 seconds 00000100:00100000:0.0:1779690483.709131:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492330112:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690483.709162:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690483.715135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690483.715482:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503680128 00000100:00100000:1.0:1779690483.715493:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503680128 00010000:00010000:1.0:1779690483.715533:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 48 pid: 57560 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690483.715575:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3257 00000100:00100000:1.0:1779690483.715585:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+48:2390:x1866137503680128:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690483.715601:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690483.715608:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 48 pid: 57560 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715622:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 48 pid: 57560 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715644:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f10a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede53 expref: 48 pid: 57560 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715663:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690483.715680:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715689:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715696:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690483.715728:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690483.715786:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:2390:x1866137503680128:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 202us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690483.715794:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3257 00010000:00010000:0.0:1779690483.720125:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720142:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690483.720187:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 0 00010000:00010000:0.0:1779690483.720653:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720663:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720670:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720676:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690483.720679:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720688:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720703:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690483.720706:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690483.720710:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720716:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f11f lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720776:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f118 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede5a expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720786:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690483.720788:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690483.720798:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f118 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede5a expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.720854:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9400, rc 0) 00000100:00100000:0.0:1779690483.720930:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:106263:x1866137503680000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 17606us (17871us total) trans 12884902215 rc 301/301 00000100:00100000:0.0:1779690483.720938:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 688 00000100:00100000:3.0:1779690483.728765:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690483.728971:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503680384 00000100:00100000:1.0:1779690483.728981:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503680384 00000100:00100000:1.0:1779690483.729032:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:1.0:1779690483.729044:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+46:106263:x1866137503680384:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000001:00080000:1.0:1779690483.729548:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902216 00000100:00100000:1.0:1779690483.729659:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+48:106263:x1866137503680384:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 616us (902us total) trans 12884902217 rc 0/0 00000100:00100000:1.0:1779690483.729667:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000020:00080000:1.0:1779690483.729672:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1779690483.731982:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.735230:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503680512 00000100:00100000:2.0:1779690483.735253:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503680512 00000100:00100000:2.0:1779690483.735321:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 689 00000100:00100000:2.0:1779690483.735331:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:106263:x1866137503680512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690483.735471:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690483.735494:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f12d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede61 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.735557:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f12d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede61 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.735573:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f12d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede61 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.735590:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690483.735593:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690483.735596:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c600, rc 0) 00000100:00100000:2.0:1779690483.735718:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+49:106263:x1866137503680512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 388us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.735726:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 689 00000100:00100000:3.0:1779690483.742215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690483.742504:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503680768 00000100:00100000:0.0:1779690483.742514:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503680768 00000100:00100000:0.0:1779690483.742571:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 690 00000100:00100000:0.0:1779690483.742581:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+49:106263:x1866137503680768:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1779690483.742644:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.742660:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.742670:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743113:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743121:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743128:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743134:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690483.743143:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743152:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743163:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:0.0:1779690483.743167:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1779690483.743171:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.743177:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f134 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690483.743341:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:106263:x1866137503680768:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 656us (1028us total) trans 12884902218 rc 0/0 00000100:00100000:0.0:1779690483.743405:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 690 00000100:00100000:1.0:1779690483.753987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690483.754112:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681024 00000100:00100000:0.0:1779690483.754122:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681024 00000100:00100000:0.0:1779690483.754185:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 691 00000100:00100000:0.0:1779690483.754195:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+50:106263:x1866137503681024:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690483.754475:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.754494:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.754505:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690483.754798:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902219 00000004:00010000:0.0:1779690483.754891:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002f7438b2 reply state 00000000b49f42fd transno 12884902220 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690483.754911:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690483.755002:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:106263:x1866137503681024:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 807us (1022us total) trans 12884902220 rc 0/0 00000100:00100000:0.0:1779690483.755010:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 691 00000020:00080000:0.0:1779690483.755015:0:57561:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690483.756636:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756650:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756656:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756662:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690483.756666:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756674:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756702:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:3.0:1779690483.756705:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690483.756709:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.756715:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f13b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690483.757273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.757334:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681280 00000100:00100000:2.0:1779690483.757341:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681280 00000100:00100000:2.0:1779690483.757385:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:2.0:1779690483.757393:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+52:106263:x1866137503681280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690483.757889:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:106263:x1866137503681280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 495us (618us total) trans 12884902221 rc 0/0 00000100:00100000:2.0:1779690483.757897:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:1.0:1779690483.792264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690483.792354:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681408 00000100:00100000:3.0:1779690483.792372:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681408 00000100:00100000:3.0:1779690483.792428:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 692 00000100:00100000:3.0:1779690483.792437:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:106265:x1866137503681408:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690483.792459:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690483.792478:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede68 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792536:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792550:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792560:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792574:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792580:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792614:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792957:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913f157 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792966:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913f157 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.792973:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913f157 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690483.793014:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 7680 00000004:00200000:3.0:1779690483.793018:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690483.793040:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913f157 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793051:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793057:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793063:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793069:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690483.793074:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793081:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793099:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690483.793102:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690483.793107:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793113:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793124:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793130:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793136:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793141:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690483.793144:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793148:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793155:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (ffff9e2f905add00) 00010000:00010000:3.0:1779690483.793158:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690483.793160:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793166:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793206:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede68 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793219:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267000/0xb4bb873a1913f157 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede68 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.793227:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:3.0:1779690483.793229:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690483.793231:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267000, rc 0) 00000100:00100000:3.0:1779690483.793293:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+54:106265:x1866137503681408:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 856us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690483.793300:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 692 00000100:00100000:3.0:1779690483.795996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.796174:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681536 00000100:00100000:2.0:1779690483.796184:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681536 00000100:00100000:2.0:1779690483.796252:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 693 00000100:00100000:2.0:1779690483.796263:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+54:106265:x1866137503681536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690483.796293:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690483.796310:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f15e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede6f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796366:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796380:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796390:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796402:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796409:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796415:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796502:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796510:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796517:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690483.796550:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 40894464 00000004:00200000:2.0:1779690483.796559:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690483.796578:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796590:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796598:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796605:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796611:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796617:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690483.796621:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796628:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796639:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:2.0:1779690483.796642:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690483.796647:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796652:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f165 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796664:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796680:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796685:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796690:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690483.796693:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796699:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796706:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0xfd36da02 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690483.796709:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690483.796712:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796717:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f16c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796746:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f15e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede6f expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796759:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede6f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.796766:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690483.796768:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690483.796776:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690483.797353:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:106265:x1866137503681536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1091us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.797363:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 693 00000100:00100000:1.0:1779690483.818493:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690483.819090:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681664 00000100:00100000:2.0:1779690483.819100:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681664 00000100:00100000:2.0:1779690483.819162:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 694 00000100:00100000:2.0:1779690483.819172:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:106267:x1866137503681664:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690483.819191:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690483.819212:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f17a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede76 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819284:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819298:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819309:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690483.819366:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 7680 00000004:00200000:2.0:1779690483.819370:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690483.819392:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819419:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f17a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819436:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690483.819457:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:2.0:1779690483.819460:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690483.819463:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d400, rc 0) 00000100:00100000:2.0:1779690483.819528:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:106267:x1866137503681664:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 357us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690483.819535:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 694 00000100:00100000:1.0:1779690483.824570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690483.824735:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503681920 00000100:00100000:0.0:1779690483.824745:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503681920 00000100:00100000:0.0:1779690483.824949:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18669 00000100:00100000:0.0:1779690483.824960:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+56:106267:x1866137503681920:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:0.0:1779690483.824976:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1779690483.824999:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f173 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede6f expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.825019:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f12d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede61 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690483.825028:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f826ec900) 00010000:00010000:0.0:1779690483.825051:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690483.825097:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+54:106267:x1866137503681920:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 139us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690483.825104:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18669 00000100:00100000:0.0:1779690483.830993:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690483.831176:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682048 00000100:00100000:3.0:1779690483.831187:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682048 00000100:00100000:3.0:1779690483.831241:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 695 00000100:00100000:3.0:1779690483.831251:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:106267:x1866137503682048:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:3.0:1779690483.831347:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.831459:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690483.831472:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1779690483.831792:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].30, 136 off12272 00000100:00100000:3.0:1779690483.832210:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:106267:x1866137503682048:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 959us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690483.832220:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 695 00010000:00010000:2.0:1779690484.168981:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690484.297993:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690484.298002:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690484.298043:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 31 count 10 00000040:00080000:0.0:1779690484.298058:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690484.298180:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492330240:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690484.298270:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690484.304452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690484.304543:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492330240:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690484.304723:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682176 00000100:00100000:3.0:1779690484.304731:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682176 00000100:00100000:3.0:1779690484.304861:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 696 00000100:00100000:3.0:1779690484.304872:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+42:106277:x1866137503682176:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690484.304911:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x88:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690484.305001:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+42:106277:x1866137503682176:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.305008:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 696 00000100:00080000:1.0:1779690484.305226:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690484.307591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690484.307677:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682304 00000100:00100000:2.0:1779690484.307686:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682304 00000100:00100000:2.0:1779690484.307740:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 697 00000100:00100000:2.0:1779690484.307749:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:106277:x1866137503682304:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690484.308183:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308201:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308212:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308259:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308266:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308273:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308308:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308315:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308321:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690484.308367:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 40894464 00000004:00200000:2.0:1779690484.308371:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690484.308382:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308392:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308398:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308404:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308409:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690484.308413:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308419:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308430:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690484.308438:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690484.308443:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308448:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f18f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308459:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308464:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308469:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308474:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690484.308477:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308482:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308490:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x7d9bdc94 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690484.308493:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690484.308495:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308501:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f196 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d9bdc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308515:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308526:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308532:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308537:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690484.308539:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308545:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308552:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:2.0:1779690484.308555:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690484.308558:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.308563:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f19d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690484.308629:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+42:106277:x1866137503682304:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 880us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.308636:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 697 00000100:00100000:1.0:1779690484.315892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.317069:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682560 00000100:00100000:3.0:1779690484.317080:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682560 00000100:00100000:3.0:1779690484.317154:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 698 00000100:00100000:3.0:1779690484.317164:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+42:106277:x1866137503682560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690484.317186:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690484.317204:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f1a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede7d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317302:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317317:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317327:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690484.317352:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 40894464 00010000:00010000:3.0:1779690484.317442:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317451:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317457:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317463:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690484.317467:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317474:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317486:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:3.0:1779690484.317488:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690484.317493:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317498:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f1ab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317536:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f1a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede7d expref: 44 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317546:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690484.317549:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1779690484.317559:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f1a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede7d expref: 44 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.317568:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:3.0:1779690484.317666:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+43:106277:x1866137503682560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 504us (1781us total) trans 12884902222 rc 301/301 00000100:00100000:3.0:1779690484.317674:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 698 00000100:00100000:3.0:1779690484.321495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690484.321847:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682688 00000100:00100000:2.0:1779690484.321857:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682688 00000100:00100000:2.0:1779690484.321919:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 699 00000100:00100000:2.0:1779690484.321931:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+43:106277:x1866137503682688:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690484.321965:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x88:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690484.322083:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+43:106277:x1866137503682688:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 154us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.322091:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 699 00000100:00100000:1.0:1779690484.328261:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.328352:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503682816 00000100:00100000:0.0:1779690484.328362:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503682816 00000100:00100000:0.0:1779690484.328419:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 700 00000100:00100000:0.0:1779690484.328429:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+43:106277:x1866137503682816:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690484.328450:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690484.328470:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f1b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede84 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328532:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328546:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328558:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328573:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328581:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328588:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328952:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f1ce lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328968:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.328976:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690484.329010:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 7680 00000004:00200000:0.0:1779690484.329014:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690484.329037:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329049:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329056:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329062:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329069:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690484.329073:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329081:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329093:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690484.329095:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690484.329100:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329116:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f1c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329127:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329133:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329138:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329143:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fe00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690484.329145:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329151:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329158:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690484.329161:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690484.329164:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329170:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329199:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f1b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede84 expref: 45 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329221:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f000/0xb4bb873a1913f1ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede84 expref: 44 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.329237:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:0.0:1779690484.329240:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690484.329245:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f000, rc 0) 00000100:00100000:0.0:1779690484.329309:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+44:106277:x1866137503682816:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 881us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.329317:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 700 00000100:00100000:1.0:1779690484.332252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.332320:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683072 00000100:00100000:0.0:1779690484.332329:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683072 00000100:00100000:0.0:1779690484.332386:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 701 00000100:00100000:0.0:1779690484.332398:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+44:106277:x1866137503683072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690484.332418:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690484.332437:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f1d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede8b expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690484.333233:0:57585:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ec:0x0], index 1: 0 00010000:00010000:0.0:1779690484.333483:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f1dc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.333499:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.333510:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.333574:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f1d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede8b expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.333590:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f1dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede8b expref: 46 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.333598:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690484.333601:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690484.333604:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e400, rc 0) 00000100:00100000:0.0:1779690484.333707:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503683072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1463us total) trans 12884902223 rc 0/0 00000100:00100000:0.0:1779690484.333715:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 701 00000100:00100000:2.0:1779690484.345407:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690484.345926:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683328 00000100:00100000:1.0:1779690484.345936:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683328 00000100:00100000:1.0:1779690484.345995:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 702 00000100:00100000:1.0:1779690484.346005:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503683328:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690484.346059:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690484.346083:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f1dc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede8b expref: 46 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.346100:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8ce00) 00010000:00010000:1.0:1779690484.346110:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690484.346131:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.346143:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.346152:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.346182:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.346195:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 53 pid: 57559 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690484.346228:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492330368:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690484.346310:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690484.351328:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492330368:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690484.351339:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:2.0:1779690484.351360:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690484.351429:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683456 00000100:00100000:3.0:1779690484.351435:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683456 00000100:00080000:1.0:1779690484.351511:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690484.351530:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 54 pid: 57559 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690484.351568:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3258 00000100:00100000:3.0:1779690484.351578:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:2391:x1866137503683456:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690484.351591:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690484.351597:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 54 pid: 57559 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351607:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 54 pid: 57559 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351627:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f181 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede76 expref: 54 pid: 57559 timeout: 3311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351640:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:3.0:1779690484.351645:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351665:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351684:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.351709:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690484.351768:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+53:2391:x1866137503683456:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 192us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.351775:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3258 00010000:00010000:2.0:1779690484.351840:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351847:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351874:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351882:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351890:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351975:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351982:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.351988:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352005:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690484.352009:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352017:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352026:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:2.0:1779690484.352028:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690484.352031:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352037:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f1ea lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352047:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352052:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352058:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352062:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690484.352065:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352071:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352088:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0xdd6c32e5 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690484.352091:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690484.352094:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.352099:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f1f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x86:0x0].0xdd6c32e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690484.352156:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+45:106277:x1866137503683328:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 6152us (6758us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690484.352163:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 702 00000100:00100000:1.0:1779690484.355103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.355188:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683584 00000100:00100000:0.0:1779690484.355197:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683584 00000100:00100000:0.0:1779690484.355252:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 703 00000100:00100000:0.0:1779690484.355262:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+45:106277:x1866137503683584:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690484.355282:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690484.355306:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f1f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede92 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355339:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1ff lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355351:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355361:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355460:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f1f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede92 expref: 47 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355475:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fe00/0xb4bb873a1913f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede92 expref: 46 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.355483:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690484.355485:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690484.355489:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fe00, rc 0) 00000100:00100000:0.0:1779690484.355547:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503683584:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 286us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.355555:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 703 00000100:00100000:3.0:1779690484.359612:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.359883:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683840 00000100:00100000:0.0:1779690484.359893:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683840 00000100:00100000:0.0:1779690484.359958:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 704 00000100:00100000:0.0:1779690484.359968:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503683840:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690484.360046:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.360063:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.360075:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690484.360572:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].7, 88 off8712 00000004:00080000:0.0:1779690484.360584:0:57585:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3211934777607ns, next at 3212934775149ns, rc = 0 00000004:00010000:0.0:1779690484.360679:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ee66811a reply state 000000004a9999a9 transno 12884902224 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690484.360688:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690484.360776:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:106277:x1866137503683840:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 809us (1173us total) trans 12884902224 rc 0/0 00000100:00100000:0.0:1779690484.360784:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 704 00010000:00010000:3.0:1779690484.362540:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362555:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362564:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362570:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690484.362574:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362582:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362596:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:3.0:1779690484.362599:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690484.362604:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.362621:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f206 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690484.363385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690484.363457:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503683968 00000100:00100000:1.0:1779690484.363468:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503683968 00000100:00100000:1.0:1779690484.363507:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 705 00000100:00100000:1.0:1779690484.363516:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:106277:x1866137503683968:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690484.363537:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690484.363555:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f20d lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bede99 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.363608:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f20d lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede99 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.363622:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9400/0xb4bb873a1913f20d lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede99 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690484.363640:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:1.0:1779690484.363643:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690484.363646:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9400, rc 0) 00000100:00100000:1.0:1779690484.363700:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:106277:x1866137503683968:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 185us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690484.363707:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 705 00000100:00100000:1.0:1779690484.365661:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.365736:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503684096 00000100:00100000:0.0:1779690484.365743:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503684096 00000100:00100000:0.0:1779690484.365824:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6431 00000100:00100000:0.0:1779690484.365835:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503684096:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1779690484.366154:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503684096:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 320us (498us total) trans 4294968412 rc 0/0 00000100:00100000:0.0:1779690484.366163:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6431 00000100:00080000:1.0:1779690484.366394:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690484.368169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690484.368270:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503684352 00000100:00100000:1.0:1779690484.368279:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503684352 00000100:00100000:1.0:1779690484.368328:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:1.0:1779690484.368339:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+48:106277:x1866137503684352:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690484.368647:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+49:106277:x1866137503684352:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 309us (482us total) trans 12884902225 rc 0/0 00000100:00100000:1.0:1779690484.368656:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:0.0:1779690484.370677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.370756:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503684608 00000100:00100000:3.0:1779690484.370764:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503684608 00000100:00100000:3.0:1779690484.370834:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 706 00000100:00100000:3.0:1779690484.370843:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:106277:x1866137503684608:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690484.370954:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:106277:x1866137503684608:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 112us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.370961:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 706 00000100:00100000:1.0:1779690484.383010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690484.384504:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503684736 00000100:00100000:0.0:1779690484.384514:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503684736 00000100:00100000:0.0:1779690484.384615:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 707 00000100:00100000:0.0:1779690484.384626:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+49:106277:x1866137503684736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690484.384645:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690484.384665:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f214 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedea0 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384731:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913f21b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384746:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913f21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384763:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913f21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690484.384798:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690484.384861:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913f21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384888:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f214 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea0 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384930:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f600/0xb4bb873a1913f21b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea0 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.384939:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:0.0:1779690484.384941:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1779690484.384945:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f600, rc 0) 00000100:00100000:0.0:1779690484.385009:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:106277:x1866137503684736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 385us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.385016:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 707 00000100:00100000:3.0:1779690484.388179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.388209:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503684864 00000100:00100000:3.0:1779690484.388218:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503684864 00000100:00100000:3.0:1779690484.388264:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6432 00000100:00100000:3.0:1779690484.388273:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503684864:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690484.388290:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690484.388309:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedea7 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690484.388333:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a13ebf4, blocks: 0x1 00010000:00010000:3.0:1779690484.388349:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690484.388351:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690484.388422:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 12 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.388454:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 12 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.388466:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:3.0:1779690484.388522:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503684864:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 250us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.388529:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6432 00000100:00100000:1.0:1779690484.391340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690484.391384:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685120 00000100:00100000:1.0:1779690484.391392:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685120 00000100:00100000:1.0:1779690484.391440:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 708 00000100:00100000:1.0:1779690484.391455:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106277:x1866137503685120:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690484.391547:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106277:x1866137503685120:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690484.391560:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 708 00000100:00100000:0.0:1779690484.401234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.401314:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685248 00000100:00100000:3.0:1779690484.401324:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685248 00000100:00100000:3.0:1779690484.401467:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6433 00000100:00100000:3.0:1779690484.401478:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+12:106277:x1866137503685248:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690484.401496:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690484.401515:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedeae expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.401547:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.401556:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690484.401559:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690484.401563:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 13 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.401595:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.401620:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 3311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690484.401633:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492330496:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690484.401789:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953df9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690484.404644:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690484.404714:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492330496:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690484.404745:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 13 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.404774:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:2.0:1779690484.404839:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:106277:x1866137503685248:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3363us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.404859:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6433 00000100:00100000:0.0:1779690484.405366:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685376 00000100:00100000:0.0:1779690484.405373:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685376 00010000:00010000:0.0:1779690484.405401:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 3311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690484.405437:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3259 00000100:00100000:0.0:1779690484.405445:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503685376:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690484.405463:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690484.405483:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 3311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.405496:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 3311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.405517:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913f222 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedea7 expref: 13 pid: 6581 timeout: 3311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.405527:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690484.405529:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690484.405535:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.405544:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690484.405575:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690484.405588:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5781:1866137492330624:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690484.405843:0:5781:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2b780 going to sleep for 11 seconds 00000100:00100000:0.0:1779690484.409322:0:5781:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5781:1866137492330624:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690484.409347:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690484.409424:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503685376:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3978us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.409436:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3259 00000100:00100000:0.0:1779690484.423680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.423907:0:6588:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685504 00000100:00100000:3.0:1779690484.423916:0:6588:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685504 00002000:00100000:3.0:1779690484.423962:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1ec:0x0] (0->1048575) req@ffff9e30a8e1f480 x1866137503685504/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:720/0 lens 488/0 e 0 to 0 dl 1779690495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690484.423972:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e1f480 with x1866137503685504 ext(0->1048575) 00002000:00010000:3.0:1779690484.423977:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30a8e1f480 00000100:00100000:2.0:1779690484.424049:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2050 00000100:00100000:2.0:1779690484.424061:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503685504:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1779690484.440408:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+14:2392:x1866137503685504:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 16285us (16747us total) trans 4294968413 rc 0/0 00000100:00100000:2.0:1779690484.440422:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2050 00002000:00100000:2.0:1779690484.440435:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (0->1048575) req@ffff9e30a8e1f480 x1866137503685504/t4294968413(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:720/0 lens 488/448 e 0 to 0 dl 1779690495 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690484.440451:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e1f480 with x1866137503685504 ext(0->1048575) 00002000:00010000:2.0:1779690484.440457:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30a8e1f480 00000040:00080000:3.0:1779690484.493960:0:68088:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690484.493969:0:68088:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690484.494095:0:68088:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 31 count 10 00000040:00080000:3.0:1779690484.494100:0:68088:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690484.534323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.534495:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685632 00000100:00100000:3.0:1779690484.534506:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685632 00000100:00100000:3.0:1779690484.535052:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 709 00000100:00100000:3.0:1779690484.535065:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:106278:x1866137503685632:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690484.535087:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690484.535119:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f230 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedeb5 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535188:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535211:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535224:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535240:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535247:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535254:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535342:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535351:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535358:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690484.535389:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x88:0x0]: returning size 40894464 00000004:00200000:3.0:1779690484.535393:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690484.535407:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535417:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535436:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535442:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535449:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535456:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690484.535460:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535467:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535480:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:3.0:1779690484.535483:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690484.535487:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535494:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f237 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535504:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535510:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535516:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535527:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690484.535531:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535537:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535545:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0xfd36da02 (ffff9e2f905ad400) 00010000:00010000:3.0:1779690484.535547:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690484.535550:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535556:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f23e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535585:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f230 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535598:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 54 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690484.535606:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:3.0:1779690484.535608:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690484.535611:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266600, rc 0) 00000100:00100000:3.0:1779690484.535668:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:106278:x1866137503685632:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 606us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.535676:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 709 00000100:00100000:3.0:1779690484.539996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690484.542312:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503685760 00000100:00100000:2.0:1779690484.542322:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503685760 00000100:00100000:2.0:1779690484.542375:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 710 00000100:00100000:2.0:1779690484.542386:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+54:106278:x1866137503685760:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690484.542404:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690484.542423:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f24c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedebc expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542485:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913f253 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542511:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913f253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542524:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913f253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690484.542589:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x86:0x0]: returning size 7680 00000004:00200000:2.0:1779690484.542593:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690484.542615:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913f253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542639:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f24c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedebc expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542656:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170cc00/0xb4bb873a1913f253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x86:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedebc expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690484.542671:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x86:0x0].0x0 (ffff9e2f905ad900) 00010000:00010000:2.0:1779690484.542674:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690484.542679:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170cc00, rc 0) 00000100:00100000:2.0:1779690484.542733:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:106278:x1866137503685760:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 350us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.542742:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 710 00000100:00100000:2.0:1779690484.549504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690484.549641:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686016 00000100:00100000:3.0:1779690484.549650:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686016 00000100:00100000:3.0:1779690484.549707:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 711 00000100:00100000:3.0:1779690484.549717:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+55:106278:x1866137503686016:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690484.550170:0:64445:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690484.550175:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690484.550210:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 31 count 10 00000040:00080000:3.0:1779690484.550216:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690484.550680:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].31, 136 off12408 00000100:00100000:3.0:1779690484.550752:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+55:106278:x1866137503686016:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1036us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690484.550760:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 711 00000100:00100000:0.0:1779690484.681106:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492330880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690484.681171:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690484.681234:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492330752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690484.681264:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690484.684132:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690484.684148:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492331264:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.684206:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690484.684271:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492330880 00000100:00100000:0.0:1779690484.684278:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492330880 00000100:00100000:0.0:1779690484.684331:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1779690484.684339:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492330880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690484.684362:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 621346816 pending 1703936 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690484.684406:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492330880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.684413:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1779690484.684428:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492330752 00000100:00100000:0.0:1779690484.684431:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492330752 00000100:00100000:0.0:1779690484.684449:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1779690484.684454:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492330752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690484.684476:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690484.684503:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492330752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (3239us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.684507:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00080000:0.0:1779690484.684525:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690484.684536:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690484.684574:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492330880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690484.684612:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492331136:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.684638:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690484.684666:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1779690484.684672:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492331008:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.684699:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690484.684733:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331264 00000100:00100000:0.0:1779690484.684737:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331264 00000100:00100000:0.0:1779690484.684860:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331136 00000100:00100000:0.0:1779690484.684864:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331136 00000100:00100000:0.0:1779690484.684885:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1779690484.685958:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492331264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.686027:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492331264:12345-0@lo:400:kworker.0 Request processed in 1135us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.686035:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1779690484.686059:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1779690484.686068:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492331136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.686100:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492331136:12345-0@lo:400:kworker.0 Request processed in 35us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690484.686107:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1779690484.686130:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690484.686158:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492331136:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.686190:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492331264:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.686235:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492330752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690484.687482:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690484.687496:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492331392:0@lo:400:kworker.0 00000100:00100000:0.0:1779690484.687537:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690484.689394:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331008 00000100:00100000:2.0:1779690484.689403:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331008 00000100:00100000:2.0:1779690484.689445:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1779690484.689451:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492331008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690484.689520:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492331008:12345-0@lo:400:kworker.0 Request processed in 68us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.689527:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1779690484.702235:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492331008:0@lo:400:kworker.0 00000100:00100000:2.0:1779690484.703315:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331392 00000100:00100000:2.0:1779690484.703323:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331392 00000100:00100000:2.0:1779690484.703383:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1779690484.703392:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492331392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690484.703467:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492331392:12345-0@lo:400:kworker.0 Request processed in 76us (15928us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690484.703473:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1779690484.703512:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492331392:0@lo:400:kworker.0 00010000:00010000:1.0:1779690485.193982:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690485.264714:0:68139:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690485.264724:0:68139:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690485.265256:0:68139:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:2.0:1779690485.265268:0:68139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690485.321732:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690485.321742:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690485.321779:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:1.0:1779690485.321787:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690485.322021:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492331520:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690485.322124:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690485.325359:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492331520:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690485.327027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690485.327588:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686144 00000100:00100000:2.0:1779690485.327599:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686144 00000100:00100000:2.0:1779690485.327655:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 712 00000100:00100000:2.0:1779690485.327665:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:106289:x1866137503686144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690485.327695:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd2:0x88:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690485.327832:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:106289:x1866137503686144:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 166us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690485.327839:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 712 00000100:00100000:3.0:1779690485.462751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690485.463193:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686272 00000100:00100000:1.0:1779690485.463203:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686272 00002000:00100000:1.0:1779690485.463249:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (1048576->2097151) req@ffff9e3086589500 x1866137503686272/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:721/0 lens 488/0 e 0 to 0 dl 1779690496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690485.463260:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086589500 with x1866137503686272 ext(1048576->2097151) 00002000:00010000:1.0:1779690485.463267:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086589500 00000100:00100000:1.0:1779690485.463333:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2051 00000100:00100000:1.0:1779690485.463343:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503686272:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690485.480118:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+16:2391:x1866137503686272:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 16767us (17368us total) trans 4294968414 rc 0/0 00000100:00100000:3.0:1779690485.480131:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2051 00002000:00100000:3.0:1779690485.480145:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (1048576->2097151) req@ffff9e3086589500 x1866137503686272/t4294968414(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:721/0 lens 488/448 e 0 to 0 dl 1779690496 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690485.480154:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086589500 with x1866137503686272 ext(1048576->2097151) 00002000:00010000:3.0:1779690485.480160:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086589500 00010000:00010000:2.0:1779690486.216966:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690486.490684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690486.490784:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686400 00000100:00100000:0.0:1779690486.490793:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686400 00002000:00100000:0.0:1779690486.490901:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (2097152->3145727) req@ffff9e30ae655f80 x1866137503686400/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:722/0 lens 488/0 e 0 to 0 dl 1779690497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690486.490921:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae655f80 with x1866137503686400 ext(2097152->3145727) 00002000:00010000:0.0:1779690486.490932:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae655f80 00000100:00100000:0.0:1779690486.490963:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2052 00000100:00100000:0.0:1779690486.490973:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+16:2392:x1866137503686400:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:2.0:1779690486.491406:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690486.501784:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+18:2392:x1866137503686400:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 10805us (11099us total) trans 4294968415 rc 0/0 00000100:00100000:0.0:1779690486.501797:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2052 00002000:00100000:0.0:1779690486.501850:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (2097152->3145727) req@ffff9e30ae655f80 x1866137503686400/t4294968415(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:722/0 lens 488/448 e 0 to 0 dl 1779690497 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690486.501859:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae655f80 with x1866137503686400 ext(2097152->3145727) 00002000:00010000:0.0:1779690486.501865:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae655f80 00000040:00080000:3.0:1779690486.903774:0:68190:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690486.903781:0:68190:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690486.903981:0:68190:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:3.0:1779690486.903987:0:68190:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690487.234608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690487.234640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690487.234659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690487.234686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690487.234693:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686912 00000100:00100000:2.0:1779690487.234704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690487.234704:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686912 00000100:00100000:2.0:1779690487.234724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690487.234755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690487.234755:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687168 00000100:00100000:0.0:1779690487.234760:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687168 00000100:00100000:2.0:1779690487.234783:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686656 00000100:00100000:2.0:1779690487.234787:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686656 00000100:00100000:0.0:1779690487.234792:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686784 00000100:00100000:0.0:1779690487.234832:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686784 00000100:00100000:2.0:1779690487.234854:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687040 00000100:00100000:2.0:1779690487.234858:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687040 00000100:00100000:0.0:1779690487.234864:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687296 00000100:00100000:0.0:1779690487.234878:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687296 00000100:00100000:2.0:1779690487.234904:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:0.0:1779690487.234911:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2886 00000100:00100000:2.0:1779690487.234917:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:2392:x1866137503686656:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690487.234925:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+18:2392:x1866137503686912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690487.235110:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2887 00000100:00100000:3.0:1779690487.235118:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503687168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690487.235181:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+18:2392:x1866137503686912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 261us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690487.235189:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2886 00000100:00100000:2.0:1779690487.235194:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:2392:x1866137503686656:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 278us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690487.235203:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:0.0:1779690487.235212:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2888 00000100:00100000:0.0:1779690487.235223:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503686784:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690487.235234:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:2.0:1779690487.235242:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:2391:x1866137503687040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690487.235251:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503686784:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690487.235257:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2888 00000100:00100000:0.0:1779690487.235272:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2889 00000100:00100000:2.0:1779690487.235279:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:2391:x1866137503687040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690487.235284:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503687296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690487.235293:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:0.0:1779690487.235314:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503687296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690487.235320:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2889 00000100:00080000:0.0:1779690487.235347:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690487.235352:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690487.235355:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690487.236185:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503686528 00000100:00100000:2.0:1779690487.236191:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503686528 00000100:00100000:2.0:1779690487.236225:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:2.0:1779690487.236232:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503686528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690487.236273:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503686528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690487.236280:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:3.0:1779690487.237537:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503687168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2415us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690487.237556:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2887 00010000:00010000:2.0:1779690487.240917:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690487.515060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690487.515120:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687424 00000100:00100000:2.0:1779690487.515130:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687424 00002000:00100000:2.0:1779690487.515175:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (3145728->4194303) req@ffff9e30888fb800 x1866137503687424/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:723/0 lens 488/0 e 0 to 0 dl 1779690498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690487.515186:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30888fb800 with x1866137503687424 ext(3145728->4194303) 00002000:00010000:2.0:1779690487.515192:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30888fb800 00000100:00100000:2.0:1779690487.515223:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2053 00000100:00100000:2.0:1779690487.515232:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+18:2391:x1866137503687424:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1779690487.537941:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+20:2391:x1866137503687424:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 22701us (22882us total) trans 4294968416 rc 0/0 00000100:00100000:2.0:1779690487.537954:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2053 00002000:00100000:2.0:1779690487.537974:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (3145728->4194303) req@ffff9e30888fb800 x1866137503687424/t4294968416(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:723/0 lens 488/448 e 0 to 0 dl 1779690498 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690487.537983:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30888fb800 with x1866137503687424 ext(3145728->4194303) 00002000:00010000:2.0:1779690487.537989:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30888fb800 00000040:00080000:1.0:1779690487.542552:0:68241:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690487.542561:0:68241:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690487.542629:0:68241:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:1.0:1779690487.542636:0:68241:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690488.265152:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690488.309295:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968415 is committed 00000001:00080000:0.0:1779690488.309381:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968416 is committed 00000001:00080000:2.0:1779690488.313901:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902224 is committed 00000004:00080000:2.0:1779690488.313910:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1779690488.313931:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902220 is committed 00000001:00080000:2.0:1779690488.313947:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902225 is committed 00000001:00080000:2.0:1779690488.313960:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902221 is committed 00000100:00100000:2.0:1779690488.314204:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690488.314224:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492331648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1779690488.314286:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690488.314438:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331648 00000100:00100000:3.0:1779690488.314445:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331648 00000100:00100000:3.0:1779690488.314501:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6434 00000100:00100000:3.0:1779690488.314510:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492331648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1779690488.314713:0:15940:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1ec:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1779690488.314717:0:15940:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1ec:0x0] updating lvb mtime from disk: 0 -> 1779690487 00002000:00010000:3.0:1779690488.314719:0:15940:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1779690488.314721:0:15940:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1ec:0x0] updating lvb ctime from disk: 1779690484 -> 1779690487 00002000:00010000:3.0:1779690488.314724:0:15940:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1ec:0x0] updating lvb blocks from disk: 1 -> 8199 00000100:00080000:0.0:1779690488.314775:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690488.314929:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492331648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 419us (640us total) trans 4294968417 rc 0/0 00000100:00100000:3.0:1779690488.314938:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6434 00000004:00080000:2.0:1779690488.315094:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e308658a680/2, rc 0, transno 4294968417 00000100:00100000:2.0:1779690488.315100:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492331648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1779690488.529750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690488.529876:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687552 00000100:00100000:3.0:1779690488.529886:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687552 00002000:00100000:3.0:1779690488.529951:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (4194304->5242879) req@ffff9e30ae657800 x1866137503687552/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:724/0 lens 488/0 e 0 to 0 dl 1779690499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690488.529963:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae657800 with x1866137503687552 ext(4194304->5242879) 00002000:00010000:3.0:1779690488.529969:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae657800 00000100:00100000:3.0:1779690488.530004:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2054 00000100:00100000:3.0:1779690488.530013:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503687552:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:0.0:1779690488.530240:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690488.557826:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503687552:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 27789us (28059us total) trans 4294968418 rc 0/0 00000100:00100000:3.0:1779690488.557866:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2054 00002000:00100000:3.0:1779690488.557878:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (4194304->5242879) req@ffff9e30ae657800 x1866137503687552/t4294968418(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:724/0 lens 488/448 e 0 to 0 dl 1779690499 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690488.557888:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae657800 with x1866137503687552 ext(4194304->5242879) 00002000:00010000:3.0:1779690488.557894:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae657800 00000040:00080000:3.0:1779690489.175767:0:68294:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690489.175775:0:68294:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690489.176367:0:68294:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:3.0:1779690489.176373:0:68294:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690489.299377:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690489.547196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690489.547533:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687680 00000100:00100000:0.0:1779690489.547543:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687680 00002000:00100000:0.0:1779690489.547599:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (5242880->6291455) req@ffff9e30ae654000 x1866137503687680/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:725/0 lens 488/0 e 0 to 0 dl 1779690500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690489.547619:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae654000 with x1866137503687680 ext(5242880->6291455) 00002000:00010000:0.0:1779690489.547625:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae654000 00000100:00100000:0.0:1779690489.547653:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2055 00000100:00100000:0.0:1779690489.547661:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503687680:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1779690489.563405:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503687680:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 15734us (16207us total) trans 4294968419 rc 0/0 00000100:00100000:0.0:1779690489.563418:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2055 00002000:00100000:0.0:1779690489.563429:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (5242880->6291455) req@ffff9e30ae654000 x1866137503687680/t4294968419(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:725/0 lens 488/448 e 0 to 0 dl 1779690500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690489.563439:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae654000 with x1866137503687680 ext(5242880->6291455) 00002000:00010000:0.0:1779690489.563456:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae654000 00000100:00100000:0.0:1779690489.804250:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804314:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804376:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1779690489.804381:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492331776:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804406:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804438:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332288:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804456:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804479:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492332032:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804499:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804528:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1779690489.804533:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492331904:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804551:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804564:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492332416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804579:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.804622:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332160 00000100:00100000:0.0:1779690489.804629:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332160 00000100:00100000:0.0:1779690489.804672:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332288 00000100:00100000:0.0:1779690489.804675:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332288 00000100:00100000:0.0:1779690489.804692:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1779690489.804699:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492332160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804740:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492332160:12345-0@lo:400:kworker.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.804747:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1779690489.804760:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1779690489.804765:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492332288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804786:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492332288:12345-0@lo:400:kworker.0 Request processed in 21us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.804791:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1779690489.804829:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332032 00000100:00100000:0.0:1779690489.804833:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332032 00000100:00100000:0.0:1779690489.804868:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331904 00000100:00100000:0.0:1779690489.804871:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331904 00000100:00100000:0.0:1779690489.804887:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332416 00000100:00100000:0.0:1779690489.804889:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332416 00000100:00100000:0.0:1779690489.804900:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1779690489.804905:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492332032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804931:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492332032:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.804943:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1779690489.804955:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1779690489.804961:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492331904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.804985:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492331904:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.804990:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1779690489.805000:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1779690489.805005:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492332416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805024:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492332416:12345-0@lo:400:kworker.0 Request processed in 20us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.805029:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1779690489.805046:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690489.805051:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690489.805072:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690489.805094:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690489.805128:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492331904:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805137:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492332416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805146:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492332032:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805173:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332544 00000100:00100000:0.0:1779690489.805177:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332544 00000100:00100000:0.0:1779690489.805198:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1779690489.805203:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492332544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690489.805215:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622919680 pending 3407872 free 3757047808 avail 3754950656 00000100:00100000:0.0:1779690489.805244:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492332544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690489.805255:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1779690489.805286:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690489.805305:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332288:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805314:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690489.805681:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690489.805705:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690489.805790:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492331776 00000100:00100000:2.0:1779690489.805795:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492331776 00000100:00100000:2.0:1779690489.805856:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1779690489.805863:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492331776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690489.805893:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492331776:12345-0@lo:400:kworker.0 Request processed in 33us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690489.805899:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1779690489.805998:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492331776:0@lo:400:kworker.0 00000100:00100000:1.0:1779690489.806051:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332672 00000100:00100000:1.0:1779690489.806054:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332672 00000100:00100000:1.0:1779690489.806118:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1779690489.806125:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492332672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690489.806148:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690489.806191:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492332672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690489.806197:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1779690489.806254:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492332672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690490.313381:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690490.568508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690490.568582:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687808 00000100:00100000:3.0:1779690490.568592:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687808 00002000:00100000:3.0:1779690490.568647:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (6291456->7340031) req@ffff9e2f94fd5880 x1866137503687808/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:726/0 lens 488/0 e 0 to 0 dl 1779690501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690490.568659:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd5880 with x1866137503687808 ext(6291456->7340031) 00002000:00010000:3.0:1779690490.568665:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd5880 00000100:00100000:3.0:1779690490.568697:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2056 00000100:00100000:3.0:1779690490.568708:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503687808:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:0.0:1779690490.568744:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690490.586145:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+17:2392:x1866137503687808:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 17430us (17636us total) trans 4294968420 rc 0/0 00000100:00100000:3.0:1779690490.586158:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2056 00002000:00100000:3.0:1779690490.586169:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (6291456->7340031) req@ffff9e2f94fd5880 x1866137503687808/t4294968420(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:726/0 lens 488/448 e 0 to 0 dl 1779690501 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690490.586179:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd5880 with x1866137503687808 ext(6291456->7340031) 00002000:00010000:3.0:1779690490.586258:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd5880 00000040:00080000:1.0:1779690490.784320:0:68345:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690490.784328:0:68345:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690490.784406:0:68345:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:1.0:1779690490.784413:0:68345:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690491.338407:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690491.589257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690491.593178:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503687936 00000100:00100000:3.0:1779690491.593192:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503687936 00002000:00100000:3.0:1779690491.593246:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (7340032->8388607) req@ffff9e2f94fd7b80 x1866137503687936/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:727/0 lens 488/0 e 0 to 0 dl 1779690502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690491.593259:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd7b80 with x1866137503687936 ext(7340032->8388607) 00002000:00010000:3.0:1779690491.593264:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd7b80 00000100:00100000:3.0:1779690491.594218:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2057 00000100:00100000:3.0:1779690491.594232:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+17:2392:x1866137503687936:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690491.615353:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+19:2392:x1866137503687936:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 21116us (26095us total) trans 4294968421 rc 0/0 00000100:00100000:3.0:1779690491.615367:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2057 00002000:00100000:3.0:1779690491.615377:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (7340032->8388607) req@ffff9e2f94fd7b80 x1866137503687936/t4294968421(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:727/0 lens 488/448 e 0 to 0 dl 1779690502 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690491.615398:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd7b80 with x1866137503687936 ext(7340032->8388607) 00002000:00010000:3.0:1779690491.615404:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd7b80 00000100:00100000:1.0:1779690492.352481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352635:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690492.352661:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688576 00000100:00100000:1.0:1779690492.352670:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688576 00000100:00100000:1.0:1779690492.352746:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688192 00000100:00100000:1.0:1779690492.352750:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688192 00000100:00100000:1.0:1779690492.352775:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:1.0:1779690492.352784:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503688576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690492.352881:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503688576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690492.352889:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:1.0:1779690492.352906:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:1.0:1779690492.352913:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:2391:x1866137503688192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690492.352936:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:2391:x1866137503688192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690492.352943:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:1.0:1779690492.352965:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688320 00000100:00100000:1.0:1779690492.352977:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688320 00000100:00100000:1.0:1779690492.353002:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688832 00000100:00100000:1.0:1779690492.353004:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688832 00000100:00100000:1.0:1779690492.353023:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688448 00000100:00100000:1.0:1779690492.353026:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688448 00000100:00100000:1.0:1779690492.353044:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688704 00000100:00100000:1.0:1779690492.353047:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688704 00000100:00100000:1.0:1779690492.353067:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2892 00000100:00100000:1.0:1779690492.353073:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503688320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690492.353099:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503688320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690492.353104:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2892 00000100:00100000:1.0:1779690492.353116:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2893 00000100:00100000:1.0:1779690492.353122:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503688832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690492.353143:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503688832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690492.353149:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2893 00000100:00100000:1.0:1779690492.353160:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2894 00000100:00100000:1.0:1779690492.353180:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503688448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690492.353393:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2895 00000100:00100000:3.0:1779690492.353403:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503688704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690492.353434:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503688704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690492.353440:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2895 00000100:00100000:1.0:1779690492.354308:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503688448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1140us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690492.354316:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2894 00000100:00080000:1.0:1779690492.354346:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690492.354351:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690492.354353:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690492.354889:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688064 00000100:00100000:2.0:1779690492.354896:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688064 00000100:00100000:2.0:1779690492.354933:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:2.0:1779690492.354940:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503688064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690492.354973:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503688064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690492.354979:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00010000:00010000:0.0:1779690492.361731:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690492.403006:0:68397:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690492.403014:0:68397:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690492.403083:0:68397:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 11 00000040:00080000:2.0:1779690492.403089:0:68397:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690492.609308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690492.609581:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503688960 00000100:00100000:0.0:1779690492.609591:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503688960 00002000:00100000:0.0:1779690492.609643:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (8388608->9437183) req@ffff9e30ae654380 x1866137503688960/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:728/0 lens 488/0 e 0 to 0 dl 1779690503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690492.609653:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae654380 with x1866137503688960 ext(8388608->9437183) 00002000:00010000:0.0:1779690492.609659:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae654380 00000100:00100000:0.0:1779690492.609692:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2058 00000100:00100000:0.0:1779690492.609702:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503688960:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690492.628499:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503688960:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 18789us (19190us total) trans 4294968422 rc 0/0 00000100:00100000:3.0:1779690492.628525:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2058 00002000:00100000:3.0:1779690492.628538:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (8388608->9437183) req@ffff9e30ae654380 x1866137503688960/t4294968422(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:728/0 lens 488/448 e 0 to 0 dl 1779690503 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690492.628548:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30ae654380 with x1866137503688960 ext(8388608->9437183) 00002000:00010000:3.0:1779690492.628555:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30ae654380 00010000:00010000:2.0:1779690493.384967:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690493.449340:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968419 is committed 00000001:00080000:1.0:1779690493.449361:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968422 is committed 00000001:00080000:1.0:1779690493.449393:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968417 is committed 00000040:00080000:0.0:1779690493.516771:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690493.516779:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690493.517221:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:0.0:1779690493.517228:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690493.635244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690493.635437:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689088 00000100:00100000:0.0:1779690493.635577:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689088 00002000:00100000:0.0:1779690493.635623:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (9437184->10485759) req@ffff9e2f8240bb80 x1866137503689088/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:729/0 lens 488/0 e 0 to 0 dl 1779690504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690493.635633:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8240bb80 with x1866137503689088 ext(9437184->10485759) 00002000:00010000:0.0:1779690493.635638:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8240bb80 00000100:00100000:0.0:1779690493.635667:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2059 00000100:00100000:0.0:1779690493.635675:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503689088:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1779690493.651922:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503689088:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 16237us (16676us total) trans 4294968423 rc 0/0 00000100:00100000:0.0:1779690493.651933:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2059 00002000:00100000:0.0:1779690493.651955:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (9437184->10485759) req@ffff9e2f8240bb80 x1866137503689088/t4294968423(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:729/0 lens 488/448 e 0 to 0 dl 1779690504 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690493.651965:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8240bb80 with x1866137503689088 ext(9437184->10485759) 00002000:00010000:0.0:1779690493.651971:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8240bb80 00000040:00080000:0.0:1779690494.051442:0:68450:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690494.051450:0:68450:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690494.051516:0:68450:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:0.0:1779690494.051522:0:68450:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690494.409023:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690494.670868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690494.670974:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689216 00000100:00100000:3.0:1779690494.670984:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689216 00002000:00100000:3.0:1779690494.671051:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (10485760->11534335) req@ffff9e2f81e94e00 x1866137503689216/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:730/0 lens 488/0 e 0 to 0 dl 1779690505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690494.671062:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e94e00 with x1866137503689216 ext(10485760->11534335) 00002000:00010000:3.0:1779690494.671068:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e94e00 00000100:00100000:3.0:1779690494.671098:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2060 00000100:00100000:3.0:1779690494.671109:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503689216:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1779690494.671523:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690494.693723:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503689216:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 22607us (22853us total) trans 4294968424 rc 0/0 00000100:00100000:3.0:1779690494.693735:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2060 00002000:00100000:3.0:1779690494.693748:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (10485760->11534335) req@ffff9e2f81e94e00 x1866137503689216/t4294968424(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:730/0 lens 488/448 e 0 to 0 dl 1779690505 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690494.693757:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e94e00 with x1866137503689216 ext(10485760->11534335) 00002000:00010000:3.0:1779690494.693763:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e94e00 00000100:00100000:3.0:1779690494.921074:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492332800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690494.921144:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690494.921232:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492333312:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921240:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492332928:0@lo:400:kworker.0 00000100:00100000:3.0:1779690494.921257:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690494.921269:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690494.921276:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690494.921281:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492333184:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921290:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492333440:0@lo:400:kworker.0 00000100:00100000:3.0:1779690494.921319:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690494.921324:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492333056:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921354:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690494.921362:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333312 00000100:00100000:3.0:1779690494.921369:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333312 00000100:00100000:0.0:1779690494.921383:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333184 00000100:00100000:0.0:1779690494.921386:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333184 00000100:00100000:0.0:1779690494.921413:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333056 00000100:00100000:0.0:1779690494.921415:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333056 00000100:00100000:3.0:1779690494.921416:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1779690494.921424:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492333312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921432:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1779690494.921438:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492333184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690494.921481:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492333312:12345-0@lo:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690494.921485:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492333184:12345-0@lo:400:kworker.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690494.921489:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:0.0:1779690494.921490:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1779690494.921505:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1779690494.921511:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492333056:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1779690494.921515:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690494.921519:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690494.921537:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492333056:12345-0@lo:400:kworker.0 Request processed in 28us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690494.921542:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1779690494.921543:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492333184:0@lo:400:kworker.0 00000100:00100000:3.0:1779690494.921553:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492333312:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921566:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492333056:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.921581:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690494.921600:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333440 00000100:00100000:3.0:1779690494.921603:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333440 00000100:00100000:3.0:1779690494.921641:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1779690494.921648:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492333440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690494.921679:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332928 00000100:00100000:3.0:1779690494.921680:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492333440:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690494.921683:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332928 00000100:00100000:3.0:1779690494.921686:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1779690494.921719:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1779690494.921726:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492332928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690494.921758:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492332928:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690494.921764:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1779690494.921960:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492332800 00000100:00100000:1.0:1779690494.921966:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492332800 00000100:00100000:1.0:1779690494.922009:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1779690494.922016:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492332800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690494.922030:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622788608 pending 3407872 free 3751804928 avail 3749707776 00000100:00100000:1.0:1779690494.922069:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492332800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690494.922076:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1779690494.922105:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968417 gen 2 00000004:00080000:1.0:1779690494.922110:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e308658a680, transno 4294968417 00000100:00100000:1.0:1779690494.922124:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492332800:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1779690494.922554:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690494.922658:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492333568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690494.922687:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690494.922728:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492332928:0@lo:400:kworker.0 00000100:00100000:0.0:1779690494.922740:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492333440:0@lo:400:kworker.0 00000100:00100000:1.0:1779690494.922875:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333568 00000100:00100000:1.0:1779690494.922880:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333568 00000100:00100000:1.0:1779690494.922951:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1779690494.922959:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492333568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690494.922980:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690494.923024:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492333568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690494.923030:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1779690494.923085:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492333568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1779690495.433960:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690495.701460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690495.701519:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689344 00000100:00100000:3.0:1779690495.701529:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689344 00002000:00100000:3.0:1779690495.701575:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (11534336->12582911) req@ffff9e2f94fd4700 x1866137503689344/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:731/0 lens 488/0 e 0 to 0 dl 1779690506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690495.701598:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd4700 with x1866137503689344 ext(11534336->12582911) 00002000:00010000:3.0:1779690495.701605:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd4700 00000100:00100000:3.0:1779690495.701636:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2061 00000100:00100000:3.0:1779690495.701646:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503689344:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1779690495.723338:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+17:2392:x1866137503689344:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 21685us (21879us total) trans 4294968425 rc 0/0 00000100:00100000:1.0:1779690495.723350:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2061 00002000:00100000:1.0:1779690495.723362:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (11534336->12582911) req@ffff9e2f94fd4700 x1866137503689344/t4294968425(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:731/0 lens 488/448 e 0 to 0 dl 1779690506 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690495.723384:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd4700 with x1866137503689344 ext(11534336->12582911) 00002000:00010000:1.0:1779690495.723403:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd4700 00000040:00080000:1.0:1779690495.797842:0:68501:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690495.797853:0:68501:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690495.797999:0:68501:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:1.0:1779690495.798006:0:68501:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690496.457306:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690496.725778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690496.725919:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689472 00000100:00100000:2.0:1779690496.725938:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689472 00002000:00100000:2.0:1779690496.726004:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (12582912->13631487) req@ffff9e308658a300 x1866137503689472/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:732/0 lens 488/0 e 0 to 0 dl 1779690507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690496.726036:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308658a300 with x1866137503689472 ext(12582912->13631487) 00002000:00010000:2.0:1779690496.726042:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e308658a300 00000100:00100000:2.0:1779690496.726081:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2062 00000100:00100000:2.0:1779690496.726091:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+17:2391:x1866137503689472:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:3.0:1779690496.726701:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690496.739321:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503689472:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 13223us (13552us total) trans 4294968426 rc 0/0 00000100:00100000:2.0:1779690496.739333:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2062 00002000:00100000:2.0:1779690496.739344:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (12582912->13631487) req@ffff9e308658a300 x1866137503689472/t4294968426(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:732/0 lens 488/448 e 0 to 0 dl 1779690507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690496.739354:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308658a300 with x1866137503689472 ext(12582912->13631487) 00002000:00010000:2.0:1779690496.739360:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e308658a300 00000100:00100000:1.0:1779690497.477516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477560:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477608:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477634:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690497.477707:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689984 00000100:00100000:1.0:1779690497.477716:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689984 00000100:00100000:1.0:1779690497.477758:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690240 00000100:00100000:1.0:1779690497.477772:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690240 00000100:00100000:1.0:1779690497.477800:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689856 00000100:00100000:1.0:1779690497.477822:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689856 00000100:00100000:1.0:1779690497.477842:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690368 00000100:00100000:1.0:1779690497.477845:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690368 00000100:00100000:1.0:1779690497.477869:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2897 00000100:00100000:1.0:1779690497.477878:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+19:2389:x1866137503689984:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.477947:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+19:2389:x1866137503689984:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.477955:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2897 00000100:00100000:1.0:1779690497.477973:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2898 00000100:00100000:1.0:1779690497.477987:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503690240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.478016:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503690240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.478021:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2898 00000100:00100000:1.0:1779690497.478034:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2899 00000100:00100000:1.0:1779690497.478040:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503689856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.478062:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503689856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.478067:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2899 00000100:00100000:1.0:1779690497.478078:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2900 00000100:00100000:1.0:1779690497.478084:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503690368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.478105:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503690368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.478111:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2900 00000100:00100000:1.0:1779690497.478133:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689728 00000100:00100000:1.0:1779690497.478136:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689728 00000100:00100000:1.0:1779690497.478162:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690112 00000100:00100000:1.0:1779690497.478165:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690112 00000100:00100000:1.0:1779690497.478184:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:1.0:1779690497.478191:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:2389:x1866137503689728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.478218:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:2389:x1866137503689728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.478224:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:1.0:1779690497.478235:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:1.0:1779690497.478248:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:2389:x1866137503690112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690497.478275:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:2389:x1866137503690112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690497.478281:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00080000:1.0:1779690497.478306:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690497.478310:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690497.478312:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690497.479793:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503689600 00000100:00100000:2.0:1779690497.479820:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503689600 00000100:00100000:2.0:1779690497.479864:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:2.0:1779690497.479873:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503689600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690497.479923:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503689600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 51us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690497.479930:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00010000:00010000:1.0:1779690497.481213:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690497.532483:0:68552:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690497.532492:0:68552:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690497.532561:0:68552:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:0.0:1779690497.532572:0:68552:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690497.771463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690497.772403:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690496 00000100:00100000:3.0:1779690497.772414:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690496 00002000:00100000:3.0:1779690497.772470:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (13631488->14680063) req@ffff9e30bf2d7100 x1866137503690496/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:733/0 lens 488/0 e 0 to 0 dl 1779690508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690497.772481:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d7100 with x1866137503690496 ext(13631488->14680063) 00002000:00010000:3.0:1779690497.772488:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d7100 00000100:00100000:3.0:1779690497.772526:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2063 00000100:00100000:3.0:1779690497.772536:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+19:2392:x1866137503690496:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690497.797785:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503690496:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 25240us (26321us total) trans 4294968427 rc 0/0 00000100:00100000:3.0:1779690497.797797:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2063 00002000:00100000:3.0:1779690497.798684:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (13631488->14680063) req@ffff9e30bf2d7100 x1866137503690496/t4294968427(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:733/0 lens 488/448 e 0 to 0 dl 1779690508 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690497.798697:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d7100 with x1866137503690496 ext(13631488->14680063) 00002000:00010000:3.0:1779690497.798703:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d7100 00010000:00010000:2.0:1779690498.504987:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690498.568175:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968423 is committed 00000001:00080000:0.0:1779690498.568210:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968425 is committed 00000001:00080000:0.0:1779690498.568222:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968426 is committed 00000001:00080000:0.0:1779690498.568231:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968427 is committed 00000100:00100000:1.0:1779690498.805584:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690498.805881:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690624 00000100:00100000:3.0:1779690498.805904:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690624 00002000:00100000:3.0:1779690498.805964:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (14680064->15728639) req@ffff9e30bf2d5500 x1866137503690624/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:734/0 lens 488/0 e 0 to 0 dl 1779690509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690498.805986:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d5500 with x1866137503690624 ext(14680064->15728639) 00002000:00010000:3.0:1779690498.805992:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d5500 00000100:00100000:3.0:1779690498.806026:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2064 00000100:00100000:3.0:1779690498.806035:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503690624:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1779690498.806102:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690498.822720:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503690624:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 16676us (17135us total) trans 4294968428 rc 0/0 00000100:00100000:1.0:1779690498.822734:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2064 00002000:00100000:1.0:1779690498.822747:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (14680064->15728639) req@ffff9e30bf2d5500 x1866137503690624/t4294968428(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:734/0 lens 488/448 e 0 to 0 dl 1779690509 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690498.822767:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d5500 with x1866137503690624 ext(14680064->15728639) 00002000:00010000:1.0:1779690498.822773:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d5500 00000040:00080000:2.0:1779690499.208686:0:68607:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690499.208693:0:68607:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690499.208777:0:68607:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:2.0:1779690499.208783:0:68607:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690499.528977:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690499.846585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690499.846689:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690752 00000100:00100000:2.0:1779690499.846699:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690752 00002000:00100000:2.0:1779690499.846759:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (15728640->16777215) req@ffff9e30bf2d4e00 x1866137503690752/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:735/0 lens 488/0 e 0 to 0 dl 1779690510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690499.846771:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d4e00 with x1866137503690752 ext(15728640->16777215) 00002000:00010000:2.0:1779690499.846777:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d4e00 00000100:00100000:2.0:1779690499.846834:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2065 00000100:00100000:2.0:1779690499.846844:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503690752:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1779690499.872397:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503690752:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 25545us (25812us total) trans 4294968429 rc 0/0 00000100:00100000:0.0:1779690499.872410:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2065 00002000:00100000:0.0:1779690499.872422:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (15728640->16777215) req@ffff9e30bf2d4e00 x1866137503690752/t4294968429(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:735/0 lens 488/448 e 0 to 0 dl 1779690510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690499.872433:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf2d4e00 with x1866137503690752 ext(15728640->16777215) 00002000:00010000:0.0:1779690499.872439:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30bf2d4e00 00000100:00100000:1.0:1779690500.041237:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690500.041307:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690500.041589:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333696 00000100:00100000:2.0:1779690500.041596:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333696 00000100:00100000:2.0:1779690500.041658:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1779690500.041666:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492333696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690500.041700:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690500.041751:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492333696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690500.041758:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00080000:1.0:1779690500.041861:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690500.041901:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690500.042070:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690500.042081:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492333824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690500.042117:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492334080:0@lo:400:kworker.0 00000100:00100000:0.0:1779690500.042195:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492333952:0@lo:400:kworker.0 00000100:00100000:1.0:1779690500.042254:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492334336:0@lo:400:kworker.0 00000100:00100000:2.0:1779690500.045136:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690500.045225:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334080 00000100:00100000:2.0:1779690500.045233:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334080 00000100:00100000:2.0:1779690500.045286:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1779690500.045296:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492334080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690500.045349:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492334080:12345-0@lo:400:kworker.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690500.045357:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:2.0:1779690500.045392:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690500.045417:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690500.045426:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492334080:0@lo:400:kworker.0 00000100:00100000:1.0:1779690500.045459:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690500.045469:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492334208:0@lo:400:kworker.0 00000100:00100000:2.0:1779690500.045473:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334336 00000100:00100000:2.0:1779690500.045477:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334336 00000100:00100000:1.0:1779690500.045505:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690500.045516:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1779690500.045525:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690500.045540:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334208 00000100:00100000:1.0:1779690500.045544:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334208 00000100:00100000:2.0:1779690500.045569:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492334336:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690500.045577:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1779690500.045581:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1779690500.045590:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492334208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1779690500.045596:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690500.045601:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690500.045628:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492334208:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690500.045635:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1779690500.045731:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492334208:0@lo:400:kworker.0 00000100:00100000:1.0:1779690500.045751:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492334336:0@lo:400:kworker.0 00000100:00100000:0.0:1779690500.045938:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690500.045978:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492334464:0@lo:400:kworker.0 00000100:00100000:3.0:1779690500.046057:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690500.046227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690500.046300:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334464 00000100:00100000:3.0:1779690500.046304:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334464 00000100:00100000:3.0:1779690500.046338:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1779690500.046345:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492334464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690500.046433:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492334464:12345-0@lo:400:kworker.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690500.046440:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1779690500.046514:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492334464:0@lo:400:kworker.0 00000100:00100000:1.0:1779690500.046556:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333824 00000100:00100000:1.0:1779690500.046560:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333824 00000100:00100000:1.0:1779690500.046622:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1779690500.046629:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492333824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690500.046644:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 623706112 pending 3407872 free 3746562048 avail 3744464896 00000100:00100000:1.0:1779690500.046879:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492333824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690500.046885:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1779690500.046965:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492333824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690500.046998:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492333952 00000100:00100000:2.0:1779690500.047004:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492333952 00000100:00100000:2.0:1779690500.047042:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1779690500.047050:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492333952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690500.047101:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492333952:12345-0@lo:400:kworker.0 Request processed in 52us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690500.047109:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1779690500.047132:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492333952:0@lo:400:kworker.0 00010000:00010000:1.0:1779690500.553607:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690500.862140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690500.862174:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503690880 00000100:00100000:3.0:1779690500.862182:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503690880 00002000:00100000:3.0:1779690500.862239:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (16777216->17825791) req@ffff9e3086588380 x1866137503690880/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:736/0 lens 488/0 e 0 to 0 dl 1779690511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690500.862250:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588380 with x1866137503690880 ext(16777216->17825791) 00002000:00010000:3.0:1779690500.862257:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588380 00000100:00100000:3.0:1779690500.862290:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2066 00000100:00100000:3.0:1779690500.862300:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503690880:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:3.0:1779690500.862450:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690500.872532:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+17:2391:x1866137503690880:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 10223us (10390us total) trans 4294968430 rc 0/0 00000100:00100000:1.0:1779690500.872546:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2066 00002000:00100000:1.0:1779690500.872559:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (16777216->17825791) req@ffff9e3086588380 x1866137503690880/t4294968430(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:736/0 lens 488/448 e 0 to 0 dl 1779690511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690500.872580:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588380 with x1866137503690880 ext(16777216->17825791) 00002000:00010000:1.0:1779690500.872586:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588380 00000040:00080000:1.0:1779690500.957557:0:68658:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690500.957566:0:68658:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690500.957632:0:68658:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:1.0:1779690500.957638:0:68658:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690501.576958:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690501.890525:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690501.893691:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691008 00000100:00100000:1.0:1779690501.893706:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691008 00002000:00100000:1.0:1779690501.893773:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (17825792->18874367) req@ffff9e3086588700 x1866137503691008/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:737/0 lens 488/0 e 0 to 0 dl 1779690512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690501.893785:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588700 with x1866137503691008 ext(17825792->18874367) 00002000:00010000:1.0:1779690501.893791:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588700 00000100:00100000:1.0:1779690501.893860:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2067 00000100:00100000:1.0:1779690501.893869:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+17:2391:x1866137503691008:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1779690501.921734:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503691008:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 27848us (31205us total) trans 4294968431 rc 0/0 00000100:00100000:1.0:1779690501.921748:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2067 00002000:00100000:1.0:1779690501.921760:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (17825792->18874367) req@ffff9e3086588700 x1866137503691008/t4294968431(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:737/0 lens 488/448 e 0 to 0 dl 1779690512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690501.921771:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588700 with x1866137503691008 ext(17825792->18874367) 00002000:00010000:1.0:1779690501.921777:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588700 00000100:00100000:0.0:1779690502.596228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690502.596257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690502.596279:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690502.596310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690502.596316:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691392 00000100:00100000:1.0:1779690502.596325:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691392 00000100:00100000:0.0:1779690502.596330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690502.596352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690502.596370:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691264 00000100:00100000:0.0:1779690502.596378:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691264 00000100:00100000:1.0:1779690502.596383:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691648 00000100:00100000:1.0:1779690502.596386:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691648 00000100:00100000:1.0:1779690502.596400:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691776 00000100:00100000:1.0:1779690502.596403:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691776 00000100:00100000:0.0:1779690502.596404:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691520 00000100:00100000:0.0:1779690502.596406:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691520 00000100:00100000:0.0:1779690502.596424:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:1.0:1779690502.596431:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2902 00000100:00100000:0.0:1779690502.596434:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:2390:x1866137503691264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690502.596437:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503691392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690502.596510:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503691392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690502.596517:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2902 00000100:00100000:1.0:1779690502.596533:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2903 00000100:00100000:1.0:1779690502.596540:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503691648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690502.596562:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691136 00000100:00100000:2.0:1779690502.596566:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691136 00000100:00100000:3.0:1779690502.596585:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2904 00000100:00100000:2.0:1779690502.596592:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:3.0:1779690502.596593:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503691776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690502.596597:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503691136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690502.598104:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:2390:x1866137503691264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1663us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690502.598114:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:1.0:1779690502.598127:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503691648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1587us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690502.598134:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2903 00000100:00100000:0.0:1779690502.598140:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:0.0:1779690502.598149:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:2390:x1866137503691520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1779690502.598157:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690502.598163:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690502.598165:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690502.598184:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:2390:x1866137503691520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690502.598190:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:3.0:1779690502.599894:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503691776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3292us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690502.599905:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2904 00000100:00100000:2.0:1779690502.600031:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503691136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3432us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690502.600040:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00010000:00010000:2.0:1779690502.602926:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690502.771745:0:68709:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690502.771753:0:68709:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690502.771837:0:68709:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 9 00000040:00080000:2.0:1779690502.771845:0:68709:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690502.910885:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690502.910960:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503691904 00000100:00100000:2.0:1779690502.910971:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503691904 00002000:00100000:2.0:1779690502.911035:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (18874368->19922943) req@ffff9e2f83089880 x1866137503691904/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:738/0 lens 488/0 e 0 to 0 dl 1779690513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690502.911046:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f83089880 with x1866137503691904 ext(18874368->19922943) 00002000:00010000:2.0:1779690502.911051:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f83089880 00000100:00100000:2.0:1779690502.911082:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2068 00000100:00100000:2.0:1779690502.911091:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503691904:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1779690502.911186:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690502.924530:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503691904:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 13431us (13644us total) trans 4294968432 rc 0/0 00000100:00100000:2.0:1779690502.924542:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2068 00002000:00100000:2.0:1779690502.924553:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (18874368->19922943) req@ffff9e2f83089880 x1866137503691904/t4294968432(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:738/0 lens 488/448 e 0 to 0 dl 1779690513 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690502.924563:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f83089880 with x1866137503691904 ext(18874368->19922943) 00002000:00010000:2.0:1779690502.924569:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f83089880 00010000:00010000:0.0:1779690503.627169:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690503.675957:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968429 is committed 00000001:00080000:1.0:1779690503.675982:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968431 is committed 00000001:00080000:1.0:1779690503.675996:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968432 is committed 00000040:00080000:0.0:1779690503.753439:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690503.753450:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690503.753890:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:0.0:1779690503.753898:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690503.950871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690503.955463:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692032 00000100:00100000:3.0:1779690503.955483:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692032 00002000:00100000:3.0:1779690503.955556:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (19922944->20971519) req@ffff9e3088326d80 x1866137503692032/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:739/0 lens 488/0 e 0 to 0 dl 1779690514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690503.955570:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088326d80 with x1866137503692032 ext(19922944->20971519) 00002000:00010000:3.0:1779690503.955578:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088326d80 00000100:00100000:3.0:1779690503.955745:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2069 00000100:00100000:3.0:1779690503.955758:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503692032:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690503.968453:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503692032:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 12681us (17582us total) trans 4294968433 rc 0/0 00000100:00100000:3.0:1779690503.968469:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2069 00002000:00100000:3.0:1779690503.968485:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (19922944->20971519) req@ffff9e3088326d80 x1866137503692032/t4294968433(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:739/0 lens 488/448 e 0 to 0 dl 1779690514 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690503.968498:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088326d80 with x1866137503692032 ext(19922944->20971519) 00002000:00010000:3.0:1779690503.968514:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088326d80 00000040:00080000:2.0:1779690504.552689:0:68763:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690504.552711:0:68763:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690504.553235:0:68763:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:2.0:1779690504.553244:0:68763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690504.650290:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690504.980243:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690504.980360:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692160 00000100:00100000:1.0:1779690504.980371:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692160 00002000:00100000:1.0:1779690504.980482:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (20971520->22020095) req@ffff9e3088327800 x1866137503692160/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:740/0 lens 488/0 e 0 to 0 dl 1779690515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690504.980496:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088327800 with x1866137503692160 ext(20971520->22020095) 00002000:00010000:1.0:1779690504.980501:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088327800 00000100:00100000:1.0:1779690504.980555:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2070 00000100:00100000:1.0:1779690504.980566:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503692160:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:3.0:1779690504.985488:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690504.997866:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503692160:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 17294us (17623us total) trans 4294968434 rc 0/0 00000100:00100000:1.0:1779690504.997879:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2070 00002000:00100000:1.0:1779690504.997890:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (20971520->22020095) req@ffff9e3088327800 x1866137503692160/t4294968434(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:740/0 lens 488/448 e 0 to 0 dl 1779690515 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690504.997899:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088327800 with x1866137503692160 ext(20971520->22020095) 00002000:00010000:1.0:1779690504.997905:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088327800 00000100:00100000:3.0:1779690505.161306:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492334592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690505.161372:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690505.161621:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690505.161630:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690505.161657:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690505.161879:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334592 00000100:00100000:0.0:1779690505.161888:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334592 00000100:00100000:0.0:1779690505.161938:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334720 00000100:00100000:0.0:1779690505.161941:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334720 00000100:00100000:0.0:1779690505.161957:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1779690505.161964:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492334592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690505.161986:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 623575040 pending 3407872 free 3741319168 avail 3739222016 00000100:00100000:0.0:1779690505.162039:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492334592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690505.162046:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1779690505.162061:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1779690505.162067:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492334720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690505.162087:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690505.162112:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492334720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690505.162117:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:3.0:1779690505.162311:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690505.162315:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690505.162345:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492334592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690505.162734:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690505.162843:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492334976:0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.162875:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690505.162907:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690505.162913:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492335104:0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.162935:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690505.162962:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334976 00000100:00100000:1.0:1779690505.162965:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334976 00000100:00100000:1.0:1779690505.163000:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335104 00000100:00100000:1.0:1779690505.163003:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335104 00000100:00100000:1.0:1779690505.163021:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1779690505.163027:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492334976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.163066:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492334976:12345-0@lo:400:kworker.0 Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690505.163081:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1779690505.163098:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1779690505.163103:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492335104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.163132:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492335104:12345-0@lo:400:kworker.0 Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690505.163229:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492335232:0@lo:400:kworker.0 00000100:00100000:3.0:1779690505.163257:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690505.163274:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690505.163280:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492334848:0@lo:400:kworker.0 00000100:00100000:3.0:1779690505.163305:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1779690505.163348:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690505.163389:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1779690505.163405:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335232 00000100:00100000:1.0:1779690505.163408:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335232 00000100:00100000:1.0:1779690505.163423:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1779690505.163428:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.163473:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492335232:12345-0@lo:400:kworker.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690505.163856:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492335104:0@lo:400:kworker.0 00000100:00100000:2.0:1779690505.163877:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492334976:0@lo:400:kworker.0 00000100:00100000:1.0:1779690505.163942:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1779690505.164020:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492335232:0@lo:400:kworker.0 00000100:00100000:0.0:1779690505.164114:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492334848 00000100:00100000:0.0:1779690505.164118:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492334848 00000100:00100000:0.0:1779690505.164160:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1779690505.164168:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690505.164213:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492334848:12345-0@lo:400:kworker.0 Request processed in 46us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690505.164219:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1779690505.164347:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492334848:0@lo:400:kworker.0 00010000:00010000:2.0:1779690505.678018:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690505.999862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690505.999958:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692288 00000100:00100000:2.0:1779690505.999968:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692288 00002000:00100000:2.0:1779690506.000017:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (22020096->23068671) req@ffff9e3086588e00 x1866137503692288/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:741/0 lens 488/0 e 0 to 0 dl 1779690516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690506.000039:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588e00 with x1866137503692288 ext(22020096->23068671) 00002000:00010000:2.0:1779690506.000046:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588e00 00000100:00100000:2.0:1779690506.000083:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2071 00000100:00100000:2.0:1779690506.000092:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503692288:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690506.017486:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+17:2392:x1866137503692288:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 17387us (17621us total) trans 4294968435 rc 0/0 00000100:00100000:3.0:1779690506.017500:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2071 00002000:00100000:3.0:1779690506.017512:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (22020096->23068671) req@ffff9e3086588e00 x1866137503692288/t4294968435(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:741/0 lens 488/448 e 0 to 0 dl 1779690516 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690506.017523:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3086588e00 with x1866137503692288 ext(22020096->23068671) 00002000:00010000:3.0:1779690506.017579:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3086588e00 00000040:00080000:0.0:1779690506.316326:0:68815:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690506.316333:0:68815:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690506.316395:0:68815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:0.0:1779690506.316401:0:68815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690506.699036:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690507.023489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690507.023622:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692416 00000100:00100000:3.0:1779690507.023645:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692416 00002000:00100000:3.0:1779690507.024233:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (23068672->24117247) req@ffff9e2f8276fb80 x1866137503692416/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:743/0 lens 488/0 e 0 to 0 dl 1779690518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690507.024257:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8276fb80 with x1866137503692416 ext(23068672->24117247) 00002000:00010000:3.0:1779690507.024263:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8276fb80 00000100:00100000:3.0:1779690507.024300:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2072 00000100:00100000:3.0:1779690507.024320:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+17:2390:x1866137503692416:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:0.0:1779690507.025422:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690507.053165:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+19:2390:x1866137503692416:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 28836us (29673us total) trans 4294968436 rc 0/0 00000100:00100000:3.0:1779690507.053181:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2072 00002000:00100000:3.0:1779690507.053196:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (23068672->24117247) req@ffff9e2f8276fb80 x1866137503692416/t4294968436(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:743/0 lens 488/448 e 0 to 0 dl 1779690518 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690507.053208:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8276fb80 with x1866137503692416 ext(23068672->24117247) 00002000:00010000:3.0:1779690507.053214:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8276fb80 00000100:00100000:1.0:1779690507.713487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690507.713636:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692800 00000100:00100000:1.0:1779690507.713645:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692800 00000100:00100000:1.0:1779690507.713702:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693056 00000100:00100000:1.0:1779690507.713705:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693056 00000100:00100000:1.0:1779690507.713718:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693184 00000100:00100000:1.0:1779690507.713720:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693184 00000100:00100000:1.0:1779690507.713739:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2905 00000100:00100000:1.0:1779690507.713747:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503692800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690507.713837:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503692800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690507.713844:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2905 00000100:00100000:1.0:1779690507.713859:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2906 00000100:00100000:1.0:1779690507.713864:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503693056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690507.713885:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503693056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690507.713891:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2906 00000100:00100000:1.0:1779690507.713900:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2907 00000100:00100000:1.0:1779690507.713905:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503693184:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690507.713922:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503693184:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 18us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690507.713927:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2907 00000100:00100000:1.0:1779690507.713943:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692672 00000100:00100000:1.0:1779690507.713946:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692672 00000100:00100000:1.0:1779690507.713970:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692928 00000100:00100000:1.0:1779690507.713972:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692928 00000100:00100000:1.0:1779690507.713992:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:1.0:1779690507.713998:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+46:2390:x1866137503692672:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690507.714244:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+46:2390:x1866137503692672:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 244us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690507.714251:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:1.0:1779690507.714273:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:1.0:1779690507.714279:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:2390:x1866137503692928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690507.714312:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:2390:x1866137503692928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690507.714319:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00080000:1.0:1779690507.714339:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690507.714343:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690507.714345:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690507.715605:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503692544 00000100:00100000:2.0:1779690507.715613:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503692544 00000100:00100000:2.0:1779690507.715678:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:2.0:1779690507.715686:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503692544:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690507.715728:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503692544:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690507.715734:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00010000:00010000:3.0:1779690507.721031:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690508.001522:0:68866:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690508.001530:0:68866:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690508.001611:0:68866:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:3.0:1779690508.001618:0:68866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690508.053910:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690508.054029:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693312 00000100:00100000:2.0:1779690508.054040:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693312 00002000:00100000:2.0:1779690508.054093:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (24117248->25165823) req@ffff9e2f81e95c00 x1866137503693312/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:744/0 lens 488/0 e 0 to 0 dl 1779690519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690508.054106:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e95c00 with x1866137503693312 ext(24117248->25165823) 00002000:00010000:2.0:1779690508.054112:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e95c00 00000100:00100000:2.0:1779690508.054189:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2073 00000100:00100000:2.0:1779690508.054210:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503693312:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1779690508.071237:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503693312:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 17015us (17332us total) trans 4294968437 rc 0/0 00000100:00100000:0.0:1779690508.071252:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2073 00002000:00100000:0.0:1779690508.071266:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (24117248->25165823) req@ffff9e2f81e95c00 x1866137503693312/t4294968437(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:744/0 lens 488/448 e 0 to 0 dl 1779690519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690508.071292:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e95c00 with x1866137503693312 ext(24117248->25165823) 00002000:00010000:0.0:1779690508.071299:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e95c00 00010000:00010000:2.0:1779690508.745119:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690508.805306:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968437 is committed 00000100:00100000:3.0:1779690509.067919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690509.068083:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693440 00000100:00100000:2.0:1779690509.068094:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693440 00002000:00100000:2.0:1779690509.068168:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (25165824->26214399) req@ffff9e2f81e94a80 x1866137503693440/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:745/0 lens 488/0 e 0 to 0 dl 1779690520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690509.068179:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e94a80 with x1866137503693440 ext(25165824->26214399) 00002000:00010000:2.0:1779690509.068184:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e94a80 00000100:00100000:2.0:1779690509.068213:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2074 00000100:00100000:2.0:1779690509.068223:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503693440:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1779690509.068944:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690509.091370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690509.091461:0:37636:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693568 00000100:00100000:1.0:1779690509.091472:0:37636:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693568 00002000:00100000:1.0:1779690509.091519:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (26214400->27262975) req@ffff9e2f81e97800 x1866137503693568/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:745/0 lens 488/0 e 0 to 0 dl 1779690520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690509.091530:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e97800 with x1866137503693568 ext(26214400->27262975) 00002000:00010000:1.0:1779690509.091536:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e97800 00000100:00100000:1.0:1779690509.091570:0:37636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2075 00000100:00100000:1.0:1779690509.091579:0:37636:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503693568:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1779690509.098620:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+15:2390:x1866137503693440:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 30389us (30701us total) trans 4294968438 rc 0/0 00000100:00100000:0.0:1779690509.098633:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2074 00002000:00100000:0.0:1779690509.098656:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ec:0x0] (25165824->26214399) req@ffff9e2f81e94a80 x1866137503693440/t4294968438(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:745/0 lens 488/448 e 0 to 0 dl 1779690520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690509.098667:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e94a80 with x1866137503693440 ext(25165824->26214399) 00002000:00010000:0.0:1779690509.098673:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e94a80 00000100:00100000:1.0:1779690509.104188:0:37636:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b7a1272b-3551-4679-9948-3e2276470519+15:2389:x1866137503693568:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 12600us (12817us total) trans 4294968439 rc 0/0 00000100:00100000:1.0:1779690509.104200:0:37636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2075 00002000:00100000:1.0:1779690509.104211:0:37636:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1ec:0x0] (26214400->27262975) req@ffff9e2f81e97800 x1866137503693568/t4294968439(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:745/0 lens 488/448 e 0 to 0 dl 1779690520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690509.104221:0:37636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e97800 with x1866137503693568 ext(26214400->27262975) 00002000:00010000:1.0:1779690509.104226:0:37636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f81e97800 00000040:00080000:3.0:1779690509.647205:0:68920:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690509.647214:0:68920:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690509.647275:0:68920:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:3.0:1779690509.647287:0:68920:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690509.770533:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690510.103013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690510.103114:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693696 00000100:00100000:1.0:1779690510.103135:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693696 00002000:00100000:1.0:1779690510.103185:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (27262976->28311551) req@ffff9e3088327480 x1866137503693696/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:746/0 lens 488/0 e 0 to 0 dl 1779690521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690510.103197:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088327480 with x1866137503693696 ext(27262976->28311551) 00002000:00010000:1.0:1779690510.103203:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088327480 00000100:00100000:1.0:1779690510.103239:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2076 00000100:00100000:1.0:1779690510.103248:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+15:2390:x1866137503693696:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1779690510.138531:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+17:2390:x1866137503693696:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 35275us (35518us total) trans 4294968440 rc 0/0 00000100:00100000:1.0:1779690510.138543:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2076 00002000:00100000:1.0:1779690510.138555:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x1ec:0x0] (27262976->28311551) req@ffff9e3088327480 x1866137503693696/t4294968440(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:746/0 lens 488/448 e 0 to 0 dl 1779690521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690510.138566:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088327480 with x1866137503693696 ext(27262976->28311551) 00002000:00010000:1.0:1779690510.138572:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088327480 00000100:00100000:2.0:1779690510.281064:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492335360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690510.281144:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690510.281303:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335360 00000100:00100000:0.0:1779690510.281311:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335360 00000100:00100000:0.0:1779690510.281376:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1779690510.281386:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492335360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690510.281414:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 624492544 pending 5111808 free 3736076288 avail 3733979136 00000100:00100000:0.0:1779690510.281467:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492335360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690510.281474:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1779690510.281597:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492335360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1779690510.281711:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690510.281951:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492335872:0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.281983:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690510.282013:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690510.282019:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492335744:0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.282056:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690510.282088:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335872 00000100:00100000:3.0:1779690510.282092:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335872 00000100:00100000:3.0:1779690510.282127:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335744 00000100:00100000:3.0:1779690510.282130:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335744 00000100:00100000:3.0:1779690510.282147:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1779690510.282151:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.282179:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492335872:12345-0@lo:400:kworker.0 Request processed in 28us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690510.282184:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1779690510.282194:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1779690510.282197:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492335744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.282212:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492335744:12345-0@lo:400:kworker.0 Request processed in 14us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690510.282215:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1779690510.282233:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492335744:0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.282243:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492335872:0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.282345:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492335488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690510.282373:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690510.282409:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492336000:0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.282432:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690510.282465:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1779690510.282471:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492335616:0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.282496:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690510.282526:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492336128:0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.282546:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690510.282587:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336128 00000100:00100000:1.0:1779690510.282591:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336128 00000100:00100000:1.0:1779690510.282616:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1779690510.282621:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492336128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.282668:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492336128:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690510.282673:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1779690510.282688:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690510.282794:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335488 00000100:00100000:2.0:1779690510.282801:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335488 00000100:00100000:2.0:1779690510.282859:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1779690510.282866:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492335488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690510.282891:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690510.282921:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492335488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690510.282927:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1779690510.283042:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492336128:0@lo:400:kworker.0 00000100:00100000:0.0:1779690510.283057:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492335488:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1779690510.283082:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690510.283138:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336000 00000100:00100000:3.0:1779690510.283142:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336000 00000100:00100000:3.0:1779690510.283177:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1779690510.283190:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492336000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690510.283273:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492336000:12345-0@lo:400:kworker.0 Request processed in 84us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690510.283279:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:1.0:1779690510.283333:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492335616 00000100:00100000:1.0:1779690510.283337:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492335616 00000100:00100000:1.0:1779690510.283369:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1779690510.283375:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690510.283406:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492335616:12345-0@lo:400:kworker.0 Request processed in 31us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690510.283412:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1779690510.283534:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492336000:0@lo:400:kworker.0 00000100:00100000:2.0:1779690510.283547:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492335616:0@lo:400:kworker.0 00010000:00010000:3.0:1779690510.793253:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690511.120667:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690511.120944:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693824 00000100:00100000:3.0:1779690511.120954:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693824 00002000:00100000:3.0:1779690511.121071:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (28311552->29360127) req@ffff9e3088325180 x1866137503693824/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:747/0 lens 488/0 e 0 to 0 dl 1779690522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690511.121082:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088325180 with x1866137503693824 ext(28311552->29360127) 00002000:00010000:3.0:1779690511.121088:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088325180 00000100:00100000:3.0:1779690511.121119:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2077 00000100:00100000:3.0:1779690511.121128:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+17:2390:x1866137503693824:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:0.0:1779690511.122492:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690511.132463:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+19:2390:x1866137503693824:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 11327us (11795us total) trans 4294968441 rc 0/0 00000100:00100000:3.0:1779690511.132475:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2077 00002000:00100000:3.0:1779690511.132486:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1ec:0x0] (28311552->29360127) req@ffff9e3088325180 x1866137503693824/t4294968441(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:747/0 lens 488/448 e 0 to 0 dl 1779690522 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690511.132496:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088325180 with x1866137503693824 ext(28311552->29360127) 00002000:00010000:3.0:1779690511.132502:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088325180 00000040:00080000:1.0:1779690511.289908:0:68971:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690511.289917:0:68971:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690511.290490:0:68971:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:1.0:1779690511.290497:0:68971:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690511.816985:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690512.149171:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690512.149470:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503693952 00000100:00100000:3.0:1779690512.149480:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503693952 00002000:00100000:3.0:1779690512.149528:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (29360128->30408703) req@ffff9e3088324700 x1866137503693952/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:748/0 lens 488/0 e 0 to 0 dl 1779690523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690512.149558:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088324700 with x1866137503693952 ext(29360128->30408703) 00002000:00010000:3.0:1779690512.149564:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088324700 00000100:00100000:3.0:1779690512.149728:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2078 00000100:00100000:3.0:1779690512.149739:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+19:2391:x1866137503693952:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1779690512.177349:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503693952:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 27601us (28176us total) trans 4294968442 rc 0/0 00000100:00100000:3.0:1779690512.177361:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2078 00002000:00100000:3.0:1779690512.177374:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1ec:0x0] (29360128->30408703) req@ffff9e3088324700 x1866137503693952/t4294968442(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:748/0 lens 488/448 e 0 to 0 dl 1779690523 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690512.177385:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e3088324700 with x1866137503693952 ext(29360128->30408703) 00002000:00010000:3.0:1779690512.177391:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e3088324700 00000100:00100000:0.0:1779690512.835862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.835902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.835938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.835956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.835975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.835992:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.836034:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690512.836062:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694464 00000100:00100000:0.0:1779690512.836071:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694464 00000100:00100000:0.0:1779690512.836114:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694720 00000100:00100000:0.0:1779690512.836117:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694720 00000100:00100000:0.0:1779690512.836143:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694336 00000100:00100000:0.0:1779690512.836145:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694336 00000100:00100000:0.0:1779690512.836164:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694848 00000100:00100000:0.0:1779690512.836166:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694848 00000100:00100000:0.0:1779690512.836188:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2909 00000100:00100000:0.0:1779690512.836197:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503694464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836284:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+21:2392:x1866137503694464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836300:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2909 00000100:00100000:0.0:1779690512.836318:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2910 00000100:00100000:0.0:1779690512.836326:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503694720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836350:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503694720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836356:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2910 00000100:00100000:0.0:1779690512.836367:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2911 00000100:00100000:0.0:1779690512.836372:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503694336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836394:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503694336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836410:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2911 00000100:00100000:0.0:1779690512.836422:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2912 00000100:00100000:0.0:1779690512.836428:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503694848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836453:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503694848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836460:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2912 00000100:00100000:0.0:1779690512.836638:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694208 00000100:00100000:0.0:1779690512.836642:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694208 00000100:00100000:0.0:1779690512.836671:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694592 00000100:00100000:0.0:1779690512.836674:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694592 00000100:00100000:0.0:1779690512.836696:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:0.0:1779690512.836702:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:2392:x1866137503694208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836731:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+46:2392:x1866137503694208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836736:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:0.0:1779690512.836748:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:0.0:1779690512.836754:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503694592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690512.836778:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503694592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690512.836784:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00080000:0.0:1779690512.836829:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690512.836834:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690512.836837:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690512.837048:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694080 00000100:00100000:3.0:1779690512.837053:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694080 00000100:00100000:3.0:1779690512.837089:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:3.0:1779690512.837097:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503694080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690512.837132:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503694080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690512.837138:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 177 00010000:00010000:1.0:1779690512.845945:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690512.971886:0:69023:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690512.971894:0:69023:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690512.971967:0:69023:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 8 00000040:00080000:1.0:1779690512.971974:0:69023:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690513.170596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690513.170785:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503694976 00000100:00100000:2.0:1779690513.170794:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503694976 00002000:00100000:2.0:1779690513.170877:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (30408704->31457279) req@ffff9e2f83088700 x1866137503694976/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:749/0 lens 488/0 e 0 to 0 dl 1779690524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690513.170885:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f83088700 with x1866137503694976 ext(30408704->31457279) 00002000:00010000:2.0:1779690513.170890:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f83088700 00000100:00100000:2.0:1779690513.170915:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2079 00000100:00100000:2.0:1779690513.170923:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+21:2391:x1866137503694976:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00080000:0.0:1779690513.170951:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690513.182570:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7a1272b-3551-4679-9948-3e2276470519+23:2391:x1866137503694976:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 11638us (11973us total) trans 4294968443 rc 0/0 00000100:00100000:2.0:1779690513.182583:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2079 00002000:00100000:2.0:1779690513.182595:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1ec:0x0] (30408704->31457279) req@ffff9e2f83088700 x1866137503694976/t4294968443(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:749/0 lens 488/448 e 0 to 0 dl 1779690524 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690513.182618:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f83088700 with x1866137503694976 ext(30408704->31457279) 00002000:00010000:2.0:1779690513.182625:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f83088700 00010000:00010000:0.0:1779690513.870941:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690513.924887:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968438 is committed 00000001:00080000:1.0:1779690513.924904:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968440 is committed 00000001:00080000:1.0:1779690513.924916:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968443 is committed 00000040:00080000:0.0:1779690513.995949:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690513.995957:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690513.996538:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 6 00000040:00080000:0.0:1779690513.996547:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690514.176320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690514.176366:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503695232 00000100:00100000:2.0:1779690514.176386:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503695232 00000100:00100000:2.0:1779690514.176463:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 713 00000100:00100000:2.0:1779690514.176474:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503695232:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690514.176583:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503695232:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 110us (270us total) trans 0 rc -125/-125 00000100:00100000:2.0:1779690514.176590:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 713 00000100:00080000:0.0:1779690514.182764:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690514.187501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690514.187576:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503695488 00000100:00100000:1.0:1779690514.187586:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503695488 00000100:00100000:1.0:1779690514.187698:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 714 00000100:00100000:1.0:1779690514.187707:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:106277:x1866137503695488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690514.187780:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.187799:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188008:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188554:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188563:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188569:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188574:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690514.188578:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188586:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188607:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:1.0:1779690514.188610:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690514.188615:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188631:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f188 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188649:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188660:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188668:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188699:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 46 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.188714:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 46 pid: 57560 timeout: 3341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690514.188728:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492336256:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690514.188839:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1779690514.191917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690514.191992:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503695616 00000100:00100000:0.0:1779690514.192000:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503695616 00010000:00010000:0.0:1779690514.192050:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 47 pid: 57560 timeout: 3341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690514.192081:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3260 00000100:00100000:0.0:1779690514.192090:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503695616:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690514.192103:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690514.192109:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 47 pid: 57560 timeout: 3341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690514.192120:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 47 pid: 57560 timeout: 3341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690514.192141:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:0.0:1779690514.192147:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690514.192157:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690514.192164:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690514.192193:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690514.192246:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503695616:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690514.192253:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3260 00000100:00080000:3.0:1779690514.192445:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690514.192904:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f245 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeb5 expref: 46 pid: 57560 timeout: 3341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690514.192923:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492336256:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690514.192945:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192954:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192967:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192978:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192984:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192989:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.192994:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690514.192998:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193004:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193013:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:1.0:1779690514.193016:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690514.193019:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193025:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f261 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193035:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193041:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193053:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193057:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690514.193060:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193066:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193073:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x88:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:1.0:1779690514.193076:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690514.193078:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690514.193084:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f25a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x88:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690514.193301:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:106277:x1866137503695488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 5595us (5806us total) trans 12884902226 rc 0/0 00000100:00100000:1.0:1779690514.193310:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 714 00000040:00080000:0.0:1779690514.193392:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690514.193397:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690514.193918:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 6 00000040:00080000:0.0:1779690514.193926:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690514.212468:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690514.213002:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503695872 00000100:00100000:3.0:1779690514.213012:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503695872 00000100:00100000:3.0:1779690514.213077:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:3.0:1779690514.213085:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+47:106277:x1866137503695872:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000001:00080000:3.0:1779690514.213577:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902227 00000004:00080000:3.0:1779690514.214529:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1779690514.215277:0:57562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].8, 64 off8776 00000004:00080000:3.0:1779690514.215291:0:57562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3241789484887ns, next at 3242789481777ns, rc = 0 00000001:00080000:3.0:1779690514.215301:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902228 00010000:00010000:3.0:1779690514.215361:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.215378:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.215389:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.215396:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.215402:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.215407:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690514.216471:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1779690514.216576:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+50:106277:x1866137503695872:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 3487us (4112us total) trans 12884902229 rc 0/0 00000100:00100000:3.0:1779690514.216586:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000020:00080000:3.0:1779690514.216591:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1779690514.218317:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690514.218328:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690514.218338:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690514.218342:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690514.218351:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690514.218366:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1d:0x0].0x0 (ffff9e2f8be8c900) 00010000:00010000:2.0:1779690514.218369:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1779690514.218373:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690514.218379:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f268 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690514.218392:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690514.218393:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690514.218395:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690514.622947:0:69076:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690514.622954:0:69076:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690514.623002:0:69076:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 6 00000040:00080000:2.0:1779690514.623008:0:69076:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690514.691914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690514.692106:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696000 00000100:00100000:2.0:1779690514.692116:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696000 00000100:00100000:2.0:1779690514.692267:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 715 00000100:00100000:2.0:1779690514.692277:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696000:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690514.692576:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696000:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 300us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690514.692598:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 715 00000100:00100000:1.0:1779690514.694624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690514.694692:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696128 00000100:00100000:2.0:1779690514.694701:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696128 00000100:00100000:2.0:1779690514.694749:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 716 00000100:00100000:2.0:1779690514.694759:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696128:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1779690514.695068:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690514.695125:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696128:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 368us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690514.695133:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 716 00000100:00100000:1.0:1779690514.698166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690514.698239:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696256 00000100:00100000:2.0:1779690514.698249:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696256 00000100:00100000:2.0:1779690514.698298:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 717 00000100:00100000:2.0:1779690514.698307:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690514.698557:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690514.698671:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 363us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690514.698679:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 717 00000100:00100000:1.0:1779690514.701770:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690514.701877:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696384 00000100:00100000:2.0:1779690514.701885:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696384 00000100:00100000:2.0:1779690514.701937:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 718 00000100:00100000:2.0:1779690514.701946:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696384:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690514.702094:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690514.702207:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696384:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 262us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690514.702214:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 718 00000100:00100000:1.0:1779690514.708686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690514.708897:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696512 00000100:00100000:3.0:1779690514.708907:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696512 00000100:00100000:3.0:1779690514.708955:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 719 00000100:00100000:3.0:1779690514.708964:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696512:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690514.709079:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696512:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 116us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690514.709087:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 719 00000100:00100000:0.0:1779690514.711575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690514.711718:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696640 00000100:00100000:3.0:1779690514.711727:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696640 00000100:00100000:0.0:1779690514.711824:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 720 00000100:00100000:0.0:1779690514.711835:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696640:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690514.711989:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696640:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 155us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690514.711999:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 720 00000100:00100000:3.0:1779690514.715286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690514.715854:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696768 00000100:00100000:0.0:1779690514.715865:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696768 00000100:00100000:0.0:1779690514.715926:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 721 00000100:00100000:0.0:1779690514.715937:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690514.716452:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 515us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690514.716461:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 721 00000100:00100000:3.0:1779690514.719760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690514.719884:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503696896 00000100:00100000:1.0:1779690514.719894:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503696896 00000100:00100000:1.0:1779690514.721549:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 722 00000100:00100000:1.0:1779690514.721577:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696896:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690514.721769:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+50:106444:x1866137503696896:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 198us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690514.721777:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 722 00010000:00010000:1.0:1779690514.889035:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690515.401017:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492336384:0@lo:400:kworker.0 00000100:00100000:1.0:1779690515.401079:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492336512:0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401107:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690515.401121:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690515.401177:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492336896:0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401224:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690515.401253:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492336640:0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401279:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690515.401302:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1779690515.401310:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492336768:0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401336:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690515.401359:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492337152:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1779690515.401363:0:57587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3242975556193ns, next at 3243975553206ns, rc = 0 00000100:00100000:2.0:1779690515.401385:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690515.401395:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336512 00000100:00100000:0.0:1779690515.401413:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336512 00000100:00100000:2.0:1779690515.401418:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336384 00000100:00100000:2.0:1779690515.401424:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336384 00000100:00100000:0.0:1779690515.401469:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336640 00000100:00100000:0.0:1779690515.401473:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336640 00000100:00100000:2.0:1779690515.401475:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1779690515.401486:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492336384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.401503:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1779690515.401513:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492336512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401542:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492336384:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690515.401550:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1779690515.401562:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492336512:12345-0@lo:400:kworker.0 Request processed in 50us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.401569:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1779690515.401598:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337152 00000100:00100000:0.0:1779690515.401603:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1779690515.401604:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337152 00000100:00100000:0.0:1779690515.401612:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492336640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401652:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1779690515.401654:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492336640:12345-0@lo:400:kworker.0 Request processed in 43us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690515.401663:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492337152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690515.401667:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1779690515.401692:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336896 00002000:00000024:2.0:1779690515.401694:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619511808 pending 0 free 3729784832 avail 3727687680 00000100:00100000:0.0:1779690515.401696:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336896 00000100:00100000:0.0:1779690515.401722:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492336768 00000100:00100000:0.0:1779690515.401725:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492336768 00000100:00100000:2.0:1779690515.401744:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492337152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.401749:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:0.0:1779690515.401759:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492336896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690515.401765:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1779690515.401793:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492336896:12345-0@lo:400:kworker.0 Request processed in 36us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.401800:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:0.0:1779690515.401828:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:0.0:1779690515.401835:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492336768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.401861:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492336768:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.401867:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00080000:0.0:1779690515.401917:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690515.401921:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690515.401924:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690515.401949:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492337280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690515.401973:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690515.401999:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337280 00000100:00100000:0.0:1779690515.402002:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337280 00000100:00100000:0.0:1779690515.402019:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1779690515.402023:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492337280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690515.402038:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690515.402062:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492337280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.402066:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1779690515.402096:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492337280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690515.402117:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690515.402124:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492336768:0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.402131:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492336640:0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.402181:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492336896:0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.402189:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492336384:0@lo:400:kworker.0 00000100:00100000:1.0:1779690515.406739:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492336512:0@lo:400:kworker.0 00000100:00100000:1.0:1779690515.406753:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492337024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690515.406826:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690515.406941:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337024 00000100:00100000:0.0:1779690515.406948:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337024 00000100:00100000:0.0:1779690515.407005:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1779690515.407014:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492337024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690515.407075:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492337024:12345-0@lo:400:kworker.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690515.407094:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1779690515.407164:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492337024:0@lo:400:kworker.0 00010000:00010000:2.0:1779690515.915835:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690516.937184:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690517.956261:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690517.956303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690517.956381:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690517.956412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690517.956463:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697536 00000100:00100000:2.0:1779690517.956473:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697536 00000100:00100000:2.0:1779690517.956536:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:2.0:1779690517.956546:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:2392:x1866137503697536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690517.956637:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:2392:x1866137503697536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690517.956645:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:3.0:1779690517.959661:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697024 00000100:00100000:3.0:1779690517.959676:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697024 00000100:00100000:3.0:1779690517.959753:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:3.0:1779690517.959762:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503697024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690517.959855:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503697024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 95us (3602us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690517.959862:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:0.0:1779690517.961190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690517.961217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690517.961415:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697280 00000100:00100000:1.0:1779690517.961421:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697280 00000100:00100000:1.0:1779690517.961459:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697792 00000100:00100000:1.0:1779690517.961462:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697792 00000100:00100000:1.0:1779690517.961481:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2915 00000100:00100000:1.0:1779690517.961489:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503697280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690517.961536:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503697280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (5233us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690517.961543:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2915 00000100:00100000:1.0:1779690517.961567:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2916 00000100:00100000:1.0:1779690517.961574:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503697792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690517.961598:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503697792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690517.961617:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2916 00000100:00100000:1.0:1779690517.961725:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697152 00000100:00100000:1.0:1779690517.961730:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697152 00000100:00100000:1.0:1779690517.961757:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:1.0:1779690517.961764:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:2392:x1866137503697152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690517.961795:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:2392:x1866137503697152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690517.961802:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00080000:1.0:1779690517.961835:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690517.961839:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690517.961841:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690517.965177:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697408 00000100:00100000:3.0:1779690517.965189:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697408 00000100:00100000:0.0:1779690517.965195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690517.965262:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697664 00000100:00100000:3.0:1779690517.965267:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697664 00000100:00100000:1.0:1779690517.965282:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2917 00000100:00100000:1.0:1779690517.965348:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503697408:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690517.965423:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503697408:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 80us (4204us total) trans 0 rc 0/0 00000100:00080000:2.0:1779690517.965642:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690517.965646:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690517.968717:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2918 00000100:00100000:2.0:1779690517.968735:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503697664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690517.968836:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503697664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 109us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690517.968845:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2918 00000100:00100000:1.0:1779690517.968938:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2917 00010000:00010000:0.0:1779690517.969017:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690518.669474:0:69272:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690518.669481:0:69272:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690518.669996:0:69272:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 9 count 2 00000040:00080000:2.0:1779690518.670066:0:69272:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690518.734162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690518.734236:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503697920 00000100:00100000:3.0:1779690518.734245:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503697920 00000100:00100000:3.0:1779690518.734305:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 723 00000100:00100000:3.0:1779690518.734317:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106893:x1866137503697920:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:3.0:1779690518.734359:0:64445:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b3947398 uarg=0000000000000000 00000004:00000080:3.0:1779690518.734398:0:64445:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b3947398 00000004:00000080:3.0:1779690518.734415:0:64445:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=8, endrec=0 00000040:00080000:3.0:1779690518.734491:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690518.734496:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1779690518.734969:0:64445:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl8 endrec = 36 00000040:00080000:3.0:1779690518.735067:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 9 count 2 00000040:00080000:3.0:1779690518.735075:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1779690518.735080:0:64445:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl8 entries up to 18446744073709551615 00000040:00080000:3.0:1779690518.735111:0:64445:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690518.735115:0:64445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1779690518.736341:0:64445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 36 count 1 00000040:00080000:3.0:1779690518.736349:0:64445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1779690518.736986:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+50:106893:x1866137503697920:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 2667us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690518.736997:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 723 00010000:00010000:0.0:1779690518.992444:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1779690519.055234:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:3.0:1779690519.055263:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902226 is committed 00000001:00080000:3.0:1779690519.055279:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902229 is committed 00000004:00080000:3.0:1779690519.055282:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1779690519.055397:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690519.055414:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492337408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1779690519.055472:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690519.055660:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337408 00000100:00100000:0.0:1779690519.055675:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337408 00000100:00100000:0.0:1779690519.055879:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6435 00000100:00100000:0.0:1779690519.055891:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492337408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1779690519.055929:0:40949:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:492 count 1 00010000:00010000:0.0:1779690519.055961:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690519.056052:0:40949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 10 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690519.056063:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690519.056065:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690519.056069:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690519.056109:0:40949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 10 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690519.056137:0:40949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 10 pid: 15940 timeout: 3346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690519.056152:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492337536:192.168.203.5@tcp:104: 00000100:00080000:0.0:1779690519.056255:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690519.059210:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30847e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1779690519.060729:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492337536:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690519.060758:0:40949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690519.120618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690519.120708:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698048 00000100:00100000:2.0:1779690519.120720:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698048 00010000:00010000:2.0:1779690519.120794:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 11 pid: 15940 timeout: 3346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690519.120864:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3261 00000100:00100000:2.0:1779690519.120879:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503698048:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690519.120912:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690519.120919:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 11 pid: 15940 timeout: 3346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.120936:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 11 pid: 15940 timeout: 3346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.120967:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913f229 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeae expref: 11 pid: 15940 timeout: 3346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.120986:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690519.120989:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690519.120995:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121007:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121057:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690519.121119:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503698048:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 246us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690519.121128:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3261 00010000:00010000:2.0:1779690519.121162:0:40949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121172:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121195:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121204:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.121223:0:40949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690519.122070:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492337408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 66178us (66593us total) trans 4294968444 rc 0/0 00000100:00100000:2.0:1779690519.122081:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6435 00010000:00010000:2.0:1779690519.122116:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690519.122124:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.122136:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690519.122140:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.122150:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.122168:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.122176:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f26f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690519.122207:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690519.122209:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690519.122211:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1779690519.122287:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1779690519.122875:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e30aef81f80/2, rc 0, transno 4294968444 00000100:00100000:3.0:1779690519.122889:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492337408:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1779690519.412493:0:69322:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffea6c45350 00000004:00000080:2.0:1779690519.412516:0:69322:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e30bef13c00 uarg=0000000000000000 00000004:00000080:2.0:1779690519.412586:0:69322:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e30bef13c00 00000004:00000080:2.0:1779690519.412595:0:69322:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=8, endrec=0 00000040:00080000:2.0:1779690519.413607:0:69322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690519.413679:0:69322:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1779690519.413892:0:69322:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl8 endrec = 36 00000040:00080000:2.0:1779690519.414229:0:69322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 9 count 2 00000040:00080000:2.0:1779690519.414239:0:69322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690519.414291:0:69322:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl8 entries up to 18446744073709551615 00000040:00080000:2.0:1779690519.414355:0:69322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690519.414358:0:69322:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690519.415286:0:69322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690519.415297:0:69322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1779690519.415330:0:69322:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=8 00000040:00080000:2.0:1779690519.415395:0:69322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690519.415399:0:69322:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690519.415965:0:69322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 8 count 1 00000040:00080000:2.0:1779690519.415971:0:69322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690519.415994:0:69322:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1779690519.415996:0:69322:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1779690519.425181:0:69322:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl8 record=18446744073709551615 00000040:00080000:2.0:1779690519.425316:0:69322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690519.425321:0:69322:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690519.427489:0:69322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690519.427511:0:69322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1779690519.427885:0:69322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690519.427890:0:69322:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690519.428707:0:69322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690519.428715:0:69322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:0.0:1779690520.008968:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690520.038421:0:69371:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690520.038429:0:69371:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690520.038980:0:69371:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690520.038990:0:69371:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690520.131491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690520.131737:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698176 00000100:00100000:1.0:1779690520.131746:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698176 00000100:00100000:1.0:1779690520.131836:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 724 00000100:00100000:1.0:1779690520.131848:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+46:106183:x1866137503698176:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1779690520.131949:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+46:106183:x1866137503698176:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 104us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690520.131957:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 724 00000100:00080000:0.0:1779690520.132459:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690520.141637:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690520.141728:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698432 00000100:00100000:1.0:1779690520.141742:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698432 00000100:00100000:1.0:1779690520.141800:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:1.0:1779690520.142029:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+46:106183:x1866137503698432:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690520.142588:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+47:106183:x1866137503698432:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 563us (957us total) trans 12884902230 rc 0/0 00000100:00100000:1.0:1779690520.143526:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:0.0:1779690520.520992:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492337792:0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521035:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492337920:0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521083:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690520.521098:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492337664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690520.521130:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521159:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492338432:0@lo:400:kworker.0 00000100:00100000:3.0:1779690520.521163:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492338176:0@lo:400:kworker.0 00000100:00100000:3.0:1779690520.521204:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521204:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521235:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690520.521237:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690520.521245:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492338304:0@lo:400:kworker.0 00000100:00100000:3.0:1779690520.521247:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492338048:0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521282:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690520.521299:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521319:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337920 00000100:00100000:1.0:1779690520.521326:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337920 00000100:00100000:3.0:1779690520.521338:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492338176 00000100:00100000:3.0:1779690520.521343:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492338176 00000100:00100000:2.0:1779690520.521370:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337664 00000100:00100000:2.0:1779690520.521376:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337664 00000100:00100000:1.0:1779690520.521386:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492338432 00000100:00100000:1.0:1779690520.521390:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492338432 00000100:00100000:3.0:1779690520.521394:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492338304 00000100:00100000:3.0:1779690520.521398:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492338304 00000100:00100000:2.0:1779690520.521415:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1779690520.521422:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1779690520.521427:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1866137492337664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690520.521432:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492338176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521432:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492338048 00000100:00100000:1.0:1779690520.521443:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492338048 00000100:00100000:1.0:1779690520.521471:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1779690520.521477:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492338176:12345-0@lo:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690520.521482:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492337920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690520.521491:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1779690520.521512:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1779690520.521522:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1866137492338304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521526:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492337920:12345-0@lo:400:kworker.0 Request processed in 46us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690520.521580:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1866137492338304:12345-0@lo:400:kworker.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690520.521586:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1779690520.521620:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1779690520.521628:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492338432:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1779690520.521646:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619511808 pending 0 free 3729784832 avail 3727687680 00000100:00100000:3.0:1779690520.521658:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492338432:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690520.521664:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1779690520.521683:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1779690520.521693:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492338048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690520.521693:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492337664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 267us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690520.521707:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1779690520.521733:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492338048:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690520.521748:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1779690520.521758:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492338048:0@lo:400:kworker.0 00000100:00100000:2.0:1779690520.521776:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492337664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690520.521786:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492338176:0@lo:400:kworker.0 00000100:00100000:3.0:1779690520.521793:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492338560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690520.521825:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1779690520.521859:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521862:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492338304:0@lo:400:kworker.0 00000100:00080000:2.0:1779690520.521864:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690520.521872:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690520.521882:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492337920:0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.521896:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492338432:0@lo:400:kworker.0 00000100:00100000:2.0:1779690520.521908:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492338560 00000100:00100000:2.0:1779690520.521913:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492338560 00000100:00100000:0.0:1779690520.521952:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690520.521984:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492337792 00000100:00100000:1.0:1779690520.521989:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492337792 00000100:00100000:2.0:1779690520.521996:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1779690520.522012:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492338560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690520.522031:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690520.522069:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492338560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690520.522072:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1779690520.522079:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1779690520.522084:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492337792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690520.522138:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492337792:12345-0@lo:400:kworker.0 Request processed in 58us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690520.522145:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1779690520.522221:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492337792:0@lo:400:kworker.0 00000100:00100000:0.0:1779690520.522258:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492338560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1779690521.035207:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690521.339420:0:69419:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 02:28:40 (1779690520) 00000100:00100000:3.0:1779690521.396700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690521.396834:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698560 00000100:00100000:0.0:1779690521.396844:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698560 00000100:00100000:0.0:1779690521.396907:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 725 00000100:00100000:0.0:1779690521.396917:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+46:107061:x1866137503698560:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690521.396937:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690521.396956:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedec3 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397031:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397045:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397055:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397069:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397076:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397082:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1779690521.397275:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690521.397399:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397408:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397414:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397421:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690521.397425:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397442:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397454:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690521.397457:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690521.397461:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397467:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f27d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397478:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397484:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397490:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397495:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690521.397497:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397503:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397509:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690521.397512:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690521.397514:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397544:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f284 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397576:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f276 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedec3 expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397586:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690521.397588:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690521.397592:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedec3 expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.397600:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:0.0:1779690521.397666:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+46:107061:x1866137503698560:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 749us (975us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690521.397673:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 725 00000100:00100000:1.0:1779690521.409969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690521.410026:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698816 00000100:00100000:3.0:1779690521.410036:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698816 00000100:00100000:3.0:1779690521.410115:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 726 00000100:00100000:3.0:1779690521.410125:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+46:107061:x1866137503698816:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1779690521.410174:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690521.410197:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f0c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede3e expref: 46 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.410212:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690521.410216:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690521.410442:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.410456:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 46 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.410464:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.410491:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 46 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.410516:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 46 pid: 57585 timeout: 3348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690521.412563:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492338688:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690521.412674:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8e8f6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1779690521.415535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690521.415564:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503698944 00000100:00100000:0.0:1779690521.415572:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503698944 00010000:00010000:0.0:1779690521.415608:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 47 pid: 57585 timeout: 3348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690521.415651:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3262 00000100:00100000:0.0:1779690521.415661:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503698944:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690521.415683:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690521.415690:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 47 pid: 57585 timeout: 3348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.415717:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 47 pid: 57585 timeout: 3348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.415738:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690521.415743:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.415752:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.415759:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.415786:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690521.415847:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+47:2391:x1866137503698944:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 187us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690521.415854:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3262 00010000:00010000:2.0:1779690521.417157:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f0ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bede4c expref: 46 pid: 57585 timeout: 3348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690521.417178:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492338688:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690521.417198:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.417206:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.417212:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.417236:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.417247:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.417255:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690521.419344:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x89:0x0]: returning size 512 00010000:00010000:2.0:1779690521.419358:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419368:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419374:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419390:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.419395:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419402:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419418:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.419421:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.419425:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.419431:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f28b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690521.419449:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000068f5f7ab reply state 000000004ebe699e transno 12884902231 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690521.419457:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690521.419559:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+47:107061:x1866137503698816:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 9433us (9597us total) trans 12884902231 rc 0/0 00000100:00100000:2.0:1779690521.419567:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 726 00010000:00010000:1.0:1779690521.422311:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422328:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422336:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422342:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690521.422354:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422363:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422378:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (ffff9e2f826ecc00) 00010000:00010000:1.0:1779690521.422382:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690521.422387:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.422393:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f292 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690521.455769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690521.455801:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699072 00000100:00100000:2.0:1779690521.455831:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699072 00000100:00100000:2.0:1779690521.455889:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 727 00000100:00100000:2.0:1779690521.455898:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+46:107070:x1866137503699072:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690521.455921:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690521.455955:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedeca expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456016:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456212:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456228:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690521.456279:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690521.456282:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 108 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690521.456301:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456323:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeca expref: 48 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456340:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeca expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.456349:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.456352:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690521.456355:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690521.456403:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+47:107070:x1866137503699072:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 506us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690521.456410:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 727 00000100:00100000:3.0:1779690521.459896:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690521.459939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690521.459968:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699200 00000100:00100000:3.0:1779690521.459976:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699200 00000100:00100000:3.0:1779690521.460015:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699456 00000100:00100000:3.0:1779690521.460018:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699456 00000100:00100000:3.0:1779690521.460045:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 728 00000100:00100000:3.0:1779690521.460055:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:2392:x1866137503699200:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:3.0:1779690521.460099:0:57559:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257846272 avail 2255749120 00000100:00100000:2.0:1779690521.460202:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 729 00000100:00100000:2.0:1779690521.460220:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+48:107070:x1866137503699456:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:2.0:1779690521.460259:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690521.460285:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeca expref: 48 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.460305:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.460317:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690521.460335:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:2392:x1866137503699200:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 279us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690521.460342:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 728 00000100:00100000:2.0:1779690521.460439:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+46:107070:x1866137503699456:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 222us (498us total) trans 0 rc -17/-17 00000100:00100000:2.0:1779690521.460445:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 729 00000100:00100000:3.0:1779690521.466689:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690521.466784:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699584 00000100:00100000:1.0:1779690521.466794:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699584 00000100:00100000:1.0:1779690521.466868:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 730 00000100:00100000:1.0:1779690521.466877:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+46:107070:x1866137503699584:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690521.466896:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690521.466918:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f2a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beded1 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467121:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467136:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467146:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690521.467210:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690521.467214:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 108 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690521.467231:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467253:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f2a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 48 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467269:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.467277:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690521.467280:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690521.467283:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8000, rc 0) 00000100:00100000:1.0:1779690521.467335:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+47:107070:x1866137503699584:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 458us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690521.467342:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 730 00000100:00100000:2.0:1779690521.477093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690521.477937:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699712 00000100:00100000:3.0:1779690521.477947:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699712 00000100:00100000:3.0:1779690521.477998:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 731 00000100:00100000:3.0:1779690521.478008:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:107070:x1866137503699712:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1779690521.478027:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690521.478615:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f2b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750beded8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478691:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478706:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478717:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478731:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478738:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478745:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478875:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478884:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478891:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690521.478929:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x89:0x0]: returning size 512 00000004:00200000:3.0:1779690521.478933:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690521.478954:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478977:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478983:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478990:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.478996:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690521.479000:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479006:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479018:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:3.0:1779690521.479021:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690521.479025:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479042:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f2bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479054:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479059:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479064:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479075:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690521.479078:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479084:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479092:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690521.479094:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690521.479096:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479102:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f2c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479131:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded8 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479141:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded8 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690521.479148:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690521.479151:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690521.479153:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266a00, rc 0) 00000100:00100000:3.0:1779690521.479211:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:107070:x1866137503699712:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1205us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690521.479219:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 731 00000100:00100000:3.0:1779690521.498201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690521.498331:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503699840 00000100:00100000:2.0:1779690521.498341:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503699840 00000100:00100000:2.0:1779690521.498397:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 732 00000100:00100000:2.0:1779690521.498407:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+48:107075:x1866137503699840:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690521.498426:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690521.498444:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bededf expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498502:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498514:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498538:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498564:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498572:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498578:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498655:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498663:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498674:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498681:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.498685:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498692:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498705:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:2.0:1779690521.498709:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.498714:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498720:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f2d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498743:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498749:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498755:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498761:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.498764:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498770:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498780:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x46626822 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.498782:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.498785:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498790:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f2df lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498861:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2d1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bededf expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498872:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:2.0:1779690521.498875:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.498886:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f2d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bededf expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.498897:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690521.498965:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+48:107075:x1866137503699840:12345-192.168.203.5@tcp:101:rm.0 Request processed in 559us (770us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690521.498974:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 732 00000100:00100000:3.0:1779690521.533712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690521.533802:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700096 00000100:00100000:1.0:1779690521.533857:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700096 00000100:00100000:1.0:1779690521.533910:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 733 00000100:00100000:1.0:1779690521.533919:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:107077:x1866137503700096:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:1.0:1779690521.533938:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690521.533940:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1779690521.533964:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f2ca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded8 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.534041:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:1.0:1779690521.534064:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690521.534080:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f2e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedee6 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534568:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534583:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534594:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534606:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534613:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.534625:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690521.535794:0:57585:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ed:0x0], index 0: 0 00010000:00010000:0.0:1779690521.535974:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.535987:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536498:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536545:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536553:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536560:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536565:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690521.536569:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536576:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536587:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f903c9e00) 00010000:00010000:0.0:1779690521.536589:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690521.536600:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536607:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f2ed lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690521.536618:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000601be28 reply state 00000000f697e6ec transno 12884902232 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690521.536626:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690521.536658:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f2e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536677:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 49 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690521.536684:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690521.536687:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690521.536689:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ec00, rc 0) 00000100:00100000:0.0:1779690521.536766:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:107077:x1866137503700096:12345-192.168.203.5@tcp:101:dd.0 Request processed in 2848us (3062us total) trans 12884902232 rc 0/0 00000100:00100000:0.0:1779690521.536776:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 733 00010000:00010000:1.0:1779690521.539137:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539495:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539503:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539509:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690521.539513:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539531:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539547:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x46626822 (ffff9e2f8be8ce00) 00010000:00010000:1.0:1779690521.539550:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690521.539554:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.539561:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f2f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690521.542104:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690521.542229:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700352 00000100:00100000:0.0:1779690521.542238:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700352 00000100:00100000:0.0:1779690521.542294:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:0.0:1779690521.542303:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107077:x1866137503700352:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690521.542634:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+50:107077:x1866137503700352:12345-192.168.203.5@tcp:35:dd.0 Request processed in 332us (538us total) trans 12884902233 rc 0/0 00000100:00100000:0.0:1779690521.542642:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:3.0:1779690521.567350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690521.567449:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700480 00000100:00100000:2.0:1779690521.567458:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700480 00000100:00100000:2.0:1779690521.567532:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 734 00000100:00100000:2.0:1779690521.567544:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107078:x1866137503700480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690521.567569:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690521.567589:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedeed expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567662:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567676:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567688:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567703:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567715:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567723:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567890:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913f31e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567899:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913f31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567906:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913f31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690521.567936:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x89:0x0]: returning size 512 00000004:00200000:2.0:1779690521.567940:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690521.567960:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913f31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567982:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.567988:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568146:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568154:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.568158:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568166:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568177:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690521.568185:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.568190:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568195:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568212:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568218:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568224:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568229:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.568231:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568237:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568244:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.568246:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.568249:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568254:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568284:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeed expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568313:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170da00/0xb4bb873a1913f31e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedeed expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.568320:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690521.568323:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690521.568325:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170da00, rc 0) 00000100:00100000:2.0:1779690521.568397:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+51:107078:x1866137503700480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 856us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690521.568405:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 734 00000100:00100000:3.0:1779690521.772773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690521.772920:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700736 00000100:00100000:2.0:1779690521.772930:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700736 00000100:00100000:2.0:1779690521.773047:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 735 00000100:00100000:2.0:1779690521.773059:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+51:107104:x1866137503700736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690521.773081:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690521.773100:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f325 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedef4 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773168:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773183:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773194:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773209:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773228:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773235:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773706:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f33a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773714:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f33a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773718:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f33a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690521.773725:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1779690521.773855:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773863:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773871:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773876:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.773880:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773886:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773908:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:2.0:1779690521.773911:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.773915:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773922:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f32c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773945:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773950:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773953:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773956:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690521.773958:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773961:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773965:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f826ec300) 00010000:00010000:2.0:1779690521.773967:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.773968:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.773972:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f333 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.774319:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f325 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedef4 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.774334:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f33a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedef4 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690521.774341:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690521.774343:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690521.774345:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690521.774964:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:107104:x1866137503700736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1905us (2196us total) trans 12884902234 rc 0/0 00000100:00100000:2.0:1779690521.774972:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 735 00000100:00100000:0.0:1779690521.783429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690521.783480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690521.783671:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700992 00000100:00100000:2.0:1779690521.783681:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700992 00000100:00100000:1.0:1779690521.783834:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503700864 00000100:00100000:1.0:1779690521.783839:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503700864 00000100:00100000:1.0:1779690521.783887:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18670 00000100:00100000:2.0:1779690521.783897:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 736 00000100:00100000:1.0:1779690521.783898:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503700864:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1779690521.783903:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:107104:x1866137503700992:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00010000:00010000:1.0:1779690521.783925:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690521.783947:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f33a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedef4 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690521.783978:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690521.783982:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690521.784003:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:107104:x1866137503700992:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 100us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690521.784003:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+53:2392:x1866137503700864:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 107us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690521.784011:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 736 00000100:00100000:1.0:1779690521.784011:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18670 00010000:00010000:2.0:1779690522.057200:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690522.378186:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690522.378194:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690522.378736:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 6 00000040:00080000:0.0:1779690522.378745:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690523.075246:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690523.075282:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690523.075291:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701120 00000100:00100000:3.0:1779690523.075300:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701120 00000100:00100000:0.0:1779690523.075309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690523.075333:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690523.075347:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:0.0:1779690523.075352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690523.075359:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503701120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690523.075374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690523.075406:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690523.075424:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503701120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690523.075430:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:3.0:1779690523.075463:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701632 00000100:00100000:3.0:1779690523.075467:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701632 00000100:00100000:3.0:1779690523.075498:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701248 00000100:00100000:3.0:1779690523.075501:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701248 00000100:00100000:3.0:1779690523.075529:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:3.0:1779690523.075534:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+46:2391:x1866137503701632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690523.075597:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701376 00000100:00100000:2.0:1779690523.075601:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701376 00000100:00100000:2.0:1779690523.075628:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701888 00000100:00100000:2.0:1779690523.075631:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701888 00000100:00100000:2.0:1779690523.075650:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701504 00000100:00100000:2.0:1779690523.075653:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701504 00000100:00100000:2.0:1779690523.075682:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503701760 00000100:00100000:2.0:1779690523.075685:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503701760 00000100:00100000:2.0:1779690523.075705:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2921 00000100:00100000:2.0:1779690523.075711:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503701376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690523.076245:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2922 00000100:00100000:0.0:1779690523.076254:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503701888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690523.076288:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503701888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690523.076295:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2922 00000100:00100000:0.0:1779690523.076310:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2923 00000100:00100000:0.0:1779690523.076315:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503701504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690523.076554:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+46:2391:x1866137503701632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1018us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690523.076561:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:3.0:1779690523.076576:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1779690523.076582:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+52:2391:x1866137503701248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690523.076606:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+52:2391:x1866137503701248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690523.076612:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:0.0:1779690523.076640:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503701504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 322us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690523.076648:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2923 00000100:00100000:0.0:1779690523.076668:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2924 00000100:00100000:0.0:1779690523.076676:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503701760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:3.0:1779690523.081555:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690523.081571:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690523.081575:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690523.081590:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503701760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4906us (6175us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690523.081603:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2924 00000100:00100000:2.0:1779690523.085106:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503701376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 9385us (9814us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690523.085120:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2921 00010000:00010000:2.0:1779690523.085205:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690523.087400:0:69515:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690523.087406:0:69515:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690523.088369:0:69515:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690523.088379:0:69515:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:1.0:1779690523.401767:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690523.401774:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690523.402244:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 32 count 5 00000040:00080000:1.0:1779690523.402251:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000020:00000080:0.0:1779690523.778907:0:69563:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe2d3f4e90 00000004:00000080:0.0:1779690523.778927:0:69563:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e308d6a7800 uarg=0000000000000000 00000004:00000080:0.0:1779690523.778979:0:69563:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e308d6a7800 00000040:00080000:0.0:1779690523.779339:0:69563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].9, 80 off8912 00000004:00000080:0.0:1779690523.779366:0:69563:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl9', mask 0x0 00000004:02000000:0.0:1779690523.779370:0:69563:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1779690523.848524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690523.848589:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702016 00000100:00100000:0.0:1779690523.848600:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702016 00000100:00100000:0.0:1779690523.848702:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 737 00000100:00100000:0.0:1779690523.848714:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+46:107142:x1866137503702016:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690523.848733:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690523.848754:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedefb expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.848845:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.848861:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.848873:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690523.848951:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690523.848955:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 108 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690523.848981:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.849004:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedefb expref: 48 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.849021:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedefb expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690523.849030:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690523.849033:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690523.849037:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e800, rc 0) 00000100:00100000:0.0:1779690523.849116:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+47:107142:x1866137503702016:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 404us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690523.849124:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 737 00000100:00100000:0.0:1779690523.856330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690523.856399:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702144 00000100:00100000:2.0:1779690523.856409:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702144 00000100:00100000:2.0:1779690523.856465:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 738 00000100:00100000:2.0:1779690523.856474:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+47:107142:x1866137503702144:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690523.856509:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690523.856527:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf02 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856587:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856602:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856613:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856627:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856634:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856648:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856768:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f36b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856777:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f36b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856784:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f36b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690523.856844:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x89:0x0]: returning size 512 00000004:00200000:2.0:1779690523.856848:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690523.856881:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f36b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856894:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856899:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856905:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856910:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690523.856914:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856921:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856939:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690523.856942:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690523.856948:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856954:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f35d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856967:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856973:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856979:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856983:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690523.856986:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856991:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.856998:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690523.857000:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690523.857002:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.857007:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f364 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.857045:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf02 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.857059:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c800/0xb4bb873a1913f36b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf02 expref: 48 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.857066:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690523.857068:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690523.857071:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c800, rc 0) 00000100:00100000:2.0:1779690523.857146:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:107142:x1866137503702144:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 673us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690523.857154:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 738 00000100:00100000:3.0:1779690523.861460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690523.861549:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702272 00000100:00100000:2.0:1779690523.861558:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702272 00000100:00100000:2.0:1779690523.861614:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 739 00000100:00100000:2.0:1779690523.861624:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+48:107142:x1866137503702272:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690523.861642:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690523.861659:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f372 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf09 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861716:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861730:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861741:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861766:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861774:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.861781:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862129:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862139:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862146:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690523.862180:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1779690523.862184:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690523.862202:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862213:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862221:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862227:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862244:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862250:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690523.862254:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862262:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862275:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690523.862278:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690523.862283:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862289:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f379 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862304:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862311:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862317:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862322:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690523.862325:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862341:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862349:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x46626822 (ffff9e2f826ec900) 00010000:00010000:2.0:1779690523.862352:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690523.862355:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862361:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f380 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862389:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f372 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862402:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.862410:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:2.0:1779690523.862412:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690523.862414:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690523.862461:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+49:107142:x1866137503702272:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 839us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690523.862468:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 739 00000100:00100000:0.0:1779690523.877459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690523.877538:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702400 00000100:00100000:1.0:1779690523.877547:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702400 00000100:00100000:1.0:1779690523.877606:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6436 00000100:00100000:1.0:1779690523.877616:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503702400:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690523.877635:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690523.877653:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf10 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690523.877679:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690523.877708:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690523.877710:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690523.877718:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690523.877753:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690523.877767:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690523.877849:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503702400:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 234us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690523.877856:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6436 00000100:00100000:0.0:1779690523.882032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690523.882159:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702528 00000100:00100000:2.0:1779690523.882168:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702528 00000100:00100000:2.0:1779690523.882221:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 740 00000100:00100000:2.0:1779690523.882232:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+49:107142:x1866137503702528:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690523.882261:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690523.882279:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf17 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882340:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882366:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882377:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690523.882433:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x89:0x0]: returning size 512 00000004:00200000:2.0:1779690523.882437:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690523.882459:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882486:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882513:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690523.882521:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:2.0:1779690523.882523:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690523.882527:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690523.882595:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+50:107142:x1866137503702528:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 364us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690523.882601:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 740 00000100:00100000:0.0:1779690523.888838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690523.888925:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702784 00000100:00100000:3.0:1779690523.888935:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702784 00000100:00100000:3.0:1779690523.889055:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 741 00000100:00100000:3.0:1779690523.889066:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:107142:x1866137503702784:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690523.889619:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].32, 136 off12544 00000100:00100000:3.0:1779690523.890403:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:107142:x1866137503702784:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1335us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690523.890412:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 741 00010000:00010000:3.0:1779690524.105253:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690524.183975:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968444 is committed 00000001:00080000:3.0:1779690524.190076:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902233 is committed 00000001:00080000:3.0:1779690524.190097:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902234 is committed 00000001:00080000:3.0:1779690524.190102:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902231 is committed 00000040:00080000:3.0:1779690524.425267:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690524.425275:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690524.425319:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 33 count 6 00000040:00080000:3.0:1779690524.425327:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690524.425835:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492338816:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690524.425927:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8e8f6d80 going to sleep for 11 seconds 00000040:00080000:0.0:1779690524.429116:0:69614:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690524.429123:0:69614:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690524.429181:0:69614:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 33 count 6 00000040:00080000:0.0:1779690524.429187:0:69614:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690524.432877:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492338816:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690524.435995:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690524.436084:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503702912 00000100:00100000:3.0:1779690524.436092:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503702912 00000100:00100000:3.0:1779690524.436177:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 742 00000100:00100000:3.0:1779690524.436188:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+48:107152:x1866137503702912:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690524.436216:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690524.436327:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+48:107152:x1866137503702912:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 140us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690524.436341:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 742 00000100:00100000:3.0:1779690524.439433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690524.439551:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503703168 00000100:00100000:2.0:1779690524.439561:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503703168 00000100:00100000:2.0:1779690524.439622:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 743 00000100:00100000:2.0:1779690524.439631:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:107152:x1866137503703168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690524.439650:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690524.439669:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f3a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf1e expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690524.439763:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f3aa lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690524.439778:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f3aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690524.439791:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f3aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690524.439829:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1779690524.440005:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f3a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf1e expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690524.440025:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f3aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf1e expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690524.440033:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:2.0:1779690524.440036:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690524.440040:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d400, rc 0) 00000100:00100000:2.0:1779690524.440210:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:107152:x1866137503703168:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 579us (784us total) trans 12884902235 rc 0/0 00000100:00100000:2.0:1779690524.440230:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 743 00000100:00100000:3.0:1779690524.443751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690524.444348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.444454:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503703296 00000100:00100000:0.0:1779690524.444479:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503703296 00000100:00100000:0.0:1779690524.444559:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18671 00000100:00100000:0.0:1779690524.444569:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+50:2391:x1866137503703296:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690524.444583:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690524.444606:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f3aa lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf1e expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.444624:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690524.444629:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690524.444684:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+49:2391:x1866137503703296:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690524.444691:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18671 00000100:00100000:1.0:1779690524.445303:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503703424 00000100:00100000:1.0:1779690524.445309:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503703424 00000100:00100000:1.0:1779690524.445441:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6437 00000100:00100000:1.0:1779690524.445450:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503703424:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690524.445484:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445507:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690524.445509:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690524.445514:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445528:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445555:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445569:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445577:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445584:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690524.445588:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445659:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445674:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.445680:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baf37b80/0xb4bb873a1913f3b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690524.445762:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503703424:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 313us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690524.445768:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6437 00000100:00100000:3.0:1779690524.451015:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690524.451062:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503703680 00000100:00100000:3.0:1779690524.451339:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503703680 00000100:00100000:3.0:1779690524.451391:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 744 00000100:00100000:3.0:1779690524.451401:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107152:x1866137503703680:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690524.451512:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107152:x1866137503703680:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 112us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690524.451520:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 744 00000100:00100000:3.0:1779690524.454374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.454419:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503703808 00000100:00100000:0.0:1779690524.454428:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503703808 00000100:00100000:0.0:1779690524.454480:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6438 00000100:00100000:0.0:1779690524.454499:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503703808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690524.454517:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690524.454534:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf25 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.454561:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690524.454563:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690524.454570:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.454587:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.454617:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e600, rc 0) 00000100:00100000:0.0:1779690524.454657:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2389:x1866137503703808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 170us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690524.454664:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6438 00000100:00100000:1.0:1779690524.461591:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.461722:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704064 00000100:00100000:0.0:1779690524.461732:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704064 00000100:00100000:0.0:1779690524.461789:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 745 00000100:00100000:0.0:1779690524.461800:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:107152:x1866137503704064:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690524.461925:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+49:107152:x1866137503704064:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690524.461933:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 745 00000100:00100000:0.0:1779690524.468413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690524.470581:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704192 00000100:00100000:1.0:1779690524.470594:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704192 00000100:00100000:1.0:1779690524.470663:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 746 00000100:00100000:1.0:1779690524.470673:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:107152:x1866137503704192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690524.470695:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690524.470716:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf2c expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470749:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470764:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470774:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470884:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 51 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470899:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690524.470907:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:1.0:1779690524.470911:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690524.470914:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690524.471030:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:107152:x1866137503704192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 359us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690524.471037:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 746 00000100:00100000:3.0:1779690524.478447:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.478522:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704320 00000100:00100000:0.0:1779690524.478530:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704320 00000100:00100000:0.0:1779690524.478583:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 747 00000100:00100000:0.0:1779690524.478592:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107152:x1866137503704320:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690524.478627:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690524.478724:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107152:x1866137503704320:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 133us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690524.478731:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 747 00000100:00100000:1.0:1779690524.481133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690524.481239:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704448 00000100:00100000:3.0:1779690524.481247:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704448 00000100:00100000:3.0:1779690524.481291:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6439 00000100:00100000:3.0:1779690524.481299:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503704448:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690524.481338:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481355:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690524.481357:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690524.481362:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481391:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481420:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481428:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481435:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481442:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690524.481446:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481454:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481468:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.481475:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a29187f/0xb4bb873a1913f3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690524.481558:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503704448:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 259us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690524.481566:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6439 00000100:00100000:2.0:1779690524.489762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690524.489890:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704704 00000100:00100000:3.0:1779690524.489900:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704704 00000100:00100000:3.0:1779690524.489946:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 748 00000100:00100000:3.0:1779690524.489956:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:107152:x1866137503704704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690524.490024:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.490041:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.490050:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.490093:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.490107:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 50 pid: 57561 timeout: 3352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690524.490121:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492338944:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690524.490203:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8e8f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690524.496436:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492338944:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690524.496475:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690524.496601:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.496664:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503704832 00000100:00100000:0.0:1779690524.496671:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503704832 00010000:00010000:0.0:1779690524.496699:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 51 pid: 57561 timeout: 3352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690524.496745:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3263 00000100:00100000:0.0:1779690524.496753:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+51:2391:x1866137503704832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690524.496766:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690524.496772:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 51 pid: 57561 timeout: 3352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496784:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 51 pid: 57561 timeout: 3352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496830:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f3cd lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf2c expref: 51 pid: 57561 timeout: 3352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496845:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690524.496850:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496860:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496867:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690524.496887:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690524.496893:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.496900:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690524.496939:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+50:2391:x1866137503704832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 187us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690524.496951:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3263 00000001:00080000:3.0:1779690524.497694:0:57585:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902236 00010000:00010000:3.0:1779690524.497719:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497727:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497733:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497738:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690524.497742:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497749:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497759:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690524.497763:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690524.497766:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690524.497772:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f3db lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690524.498424:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:107152:x1866137503704704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 8466us (8666us total) trans 12884902237 rc 0/0 00000100:00100000:3.0:1779690524.498433:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 748 00000020:00080000:3.0:1779690524.498437:0:57585:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1779690524.498829:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690524.498839:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690524.499368:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 6 00000040:00080000:0.0:1779690524.499377:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690524.501305:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690524.501386:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705088 00000100:00100000:0.0:1779690524.501395:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705088 00000100:00100000:0.0:1779690524.501448:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:0.0:1779690524.501458:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+51:107152:x1866137503705088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690524.502177:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107152:x1866137503705088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 719us (876us total) trans 12884902238 rc 0/0 00000100:00100000:0.0:1779690524.502185:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00010000:00010000:2.0:1779690525.129039:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690525.641774:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690525.641795:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492339072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690525.641870:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690525.641962:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339072 00000100:00100000:0.0:1779690525.641970:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339072 00000100:00100000:0.0:1779690525.642025:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1779690525.642033:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492339072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690525.642067:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619511808 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690525.642119:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492339072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690525.642125:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:0.0:1779690525.642148:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690525.642173:0:3320:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968444 gen 2 00000004:00080000:0.0:1779690525.642178:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e30aef81f80, transno 4294968444 00000100:00100000:0.0:1779690525.642193:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492339072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690525.643631:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690525.643648:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492339200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690525.643700:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690525.643751:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339200 00000100:00100000:2.0:1779690525.643756:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339200 00000100:00100000:2.0:1779690525.643989:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1779690525.643998:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492339200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690525.644028:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690525.644064:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492339200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690525.644069:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00080000:2.0:1779690525.644086:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690525.644112:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492339200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690525.645991:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492339328:0@lo:400:kworker.0 00000100:00100000:1.0:1779690525.646013:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492339584:0@lo:400:kworker.0 00000100:00100000:2.0:1779690525.646048:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690525.646071:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690525.646094:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690525.646102:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492339712:0@lo:400:kworker.0 00000100:00100000:1.0:1779690525.646105:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690525.646114:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492339456:0@lo:400:kworker.0 00000100:00100000:2.0:1779690525.646146:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690525.646182:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339328 00000100:00100000:2.0:1779690525.646189:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339328 00000100:00100000:2.0:1779690525.646233:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1779690525.646263:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492339328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690525.646306:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492339328:12345-0@lo:400:kworker.0 Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690525.646314:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1779690525.646491:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690525.648678:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492339328:0@lo:400:kworker.0 00000100:00100000:1.0:1779690525.655412:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339584 00000100:00100000:1.0:1779690525.655423:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339584 00000100:00100000:2.0:1779690525.655429:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339712 00000100:00100000:2.0:1779690525.655435:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339712 00000100:00100000:2.0:1779690525.655497:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492339456 00000100:00100000:2.0:1779690525.655501:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492339456 00000100:00100000:0.0:1779690525.656132:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1779690525.656144:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492339712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690525.656247:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492339712:12345-0@lo:400:kworker.0 Request processed in 106us (10101us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690525.656255:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1779690525.660797:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1779690525.660826:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492339584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690525.660914:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492339584:12345-0@lo:400:kworker.0 Request processed in 108us (14844us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690525.660921:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1779690525.661024:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690525.661068:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492339584:0@lo:400:kworker.0 00000100:00100000:1.0:1779690525.661159:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492339712:0@lo:400:kworker.0 00000100:00100000:2.0:1779690525.661505:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1779690525.661520:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492339456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690525.661574:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492339456:12345-0@lo:400:kworker.0 Request processed in 60us (15083us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690525.661582:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1779690525.661635:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492339456:0@lo:400:kworker.0 00010000:00010000:2.0:1779690526.154314:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690526.168301:0:69665:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690526.168311:0:69665:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690526.168373:0:69665:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 33 count 6 00000040:00080000:3.0:1779690526.168380:0:69665:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690526.207070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690526.207145:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705344 00000100:00100000:1.0:1779690526.207154:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705344 00000100:00100000:1.0:1779690526.207247:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 749 00000100:00100000:1.0:1779690526.207257:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+49:107161:x1866137503705344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690526.207276:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690526.207296:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f3e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf33 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.207423:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.207452:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.207486:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690526.207501:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1779690526.207630:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f3e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf33 expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.207646:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf33 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.207655:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:1.0:1779690526.207658:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1779690526.207661:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690526.207717:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:107161:x1866137503705344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 462us (654us total) trans 12884902239 rc 0/0 00000100:00100000:1.0:1779690526.207725:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 749 00000100:00080000:2.0:1779690526.207996:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690526.209687:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690526.210103:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705472 00000100:00100000:0.0:1779690526.210111:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705472 00000100:00100000:0.0:1779690526.210174:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6440 00000100:00100000:0.0:1779690526.210183:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2389:x1866137503705472:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:0.0:1779690526.210220:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210240:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210248:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 7 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210255:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690526.210257:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690526.210260:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210292:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 7 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210306:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 7 pid: 49882 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690526.210327:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492339840:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690526.210418:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.210429:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690526.210438:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492339968:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690526.210461:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8fc0c3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1779690526.210872:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690526.213158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690526.213190:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705600 00000100:00100000:3.0:1779690526.213197:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705600 00010000:00010000:3.0:1779690526.213231:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 19 pid: 22747 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690526.213264:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3264 00000100:00100000:3.0:1779690526.213273:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503705600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690526.213285:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690526.213353:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 19 pid: 22747 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.213365:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 19 pid: 22747 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.213404:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690526.213447:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503705600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 175us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690526.213454:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3264 00000100:00100000:1.0:1779690526.213657:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492339840:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690526.213670:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f38e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf10 expref: 18 pid: 22747 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690526.213683:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492339968:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690526.213709:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690526.215692:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690526.215756:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705728 00000100:00100000:1.0:1779690526.215769:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705728 00010000:00010000:1.0:1779690526.215836:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690526.215879:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3265 00000100:00100000:1.0:1779690526.215889:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503705728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690526.215901:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690526.215932:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.215947:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.215966:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2f5244/0xb4bb873a1913f3bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf25 expref: 8 pid: 49882 timeout: 3353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.215978:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690526.215980:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690526.215985:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.215995:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.216024:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690526.216069:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503705728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 181us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690526.216086:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3265 00010000:00010000:0.0:1779690526.216154:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216164:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216191:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216200:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216209:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216223:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690526.216227:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216236:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216260:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.216267:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f3f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690526.216330:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503705472:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 6147us (6645us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690526.216339:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6440 00000100:00080000:3.0:1779690526.216394:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690526.218778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690526.219240:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503705984 00000100:00100000:1.0:1779690526.219248:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503705984 00000100:00100000:1.0:1779690526.219299:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:1.0:1779690526.219309:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+51:107161:x1866137503705984:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:1.0:1779690526.219361:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf33 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690526.219846:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902240 00000001:00080000:1.0:1779690526.222414:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902241 00010000:00010000:1.0:1779690526.222520:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.222540:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.222550:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.222558:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.222736:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.222752:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 54 pid: 57561 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690526.222780:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492340096:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690526.223169:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.223179:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 51 pid: 57585 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690526.223188:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492340224:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690526.223213:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1779690526.227344:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492340096:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690526.227359:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492340224:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690526.227387:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690526.231712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690526.231967:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706240 00000100:00100000:3.0:1779690526.231976:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706240 00010000:00010000:3.0:1779690526.232012:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 55 pid: 57561 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690526.232056:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3266 00000100:00100000:3.0:1779690526.232066:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2392:x1866137503706240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690526.232080:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690526.232087:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 55 pid: 57561 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232101:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 55 pid: 57561 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232122:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f387 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf09 expref: 55 pid: 57561 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232363:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690526.232369:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232390:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232396:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690526.232449:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:2392:x1866137503706240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 384us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690526.232456:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3266 00000100:00100000:3.0:1779690526.232514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690526.232594:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706112 00000100:00100000:3.0:1779690526.232599:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706112 00010000:00010000:3.0:1779690526.232623:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 52 pid: 57585 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690526.232645:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3267 00000100:00100000:3.0:1779690526.232652:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2392:x1866137503706112:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690526.232660:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690526.232664:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 52 pid: 57585 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232674:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 52 pid: 57585 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232686:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f2fb lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedee6 expref: 52 pid: 57585 timeout: 3353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232696:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690526.232706:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232713:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232720:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.232741:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690526.232767:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+51:2392:x1866137503706112:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 115us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690526.232773:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3267 00000100:00080000:3.0:1779690526.232794:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690526.232896:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.232903:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690526.233224:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902242 00000001:00080000:1.0:1779690526.233795:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902243 00000001:00080000:1.0:1779690526.233998:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902244 00000100:00100000:1.0:1779690526.234086:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492340352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1779690526.234163:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690526.234200:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f901d8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690526.234304:0:40938:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492340352 00000100:00100000:2.0:1779690526.234310:0:40938:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492340352 00000100:00100000:2.0:1779690526.234352:0:40938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455 00000100:00100000:2.0:1779690526.234361:0:40938:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492340352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690526.234438:0:40938:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492340352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690526.234447:0:40938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455 00000100:00100000:3.0:1779690526.234988:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492340352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1779690526.235314:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902245 00010000:00010000:3.0:1779690526.235353:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235365:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235373:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235379:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690526.235384:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235393:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235418:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690526.235420:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1779690526.235425:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690526.235431:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f3fe lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690526.235720:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x8a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1779690526.236124:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].9, 64 off8816 00000004:00080000:3.0:1779690526.236780:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3253810973153ns, next at 3254810969413ns, rc = 0 00000001:00080000:3.0:1779690526.236792:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902246 00010000:00010000:3.0:1779690526.237000:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690526.237006:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690526.237015:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f3e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf33 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690526.237327:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902247 00000100:00100000:3.0:1779690526.237701:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+58:107161:x1866137503705984:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 18393us (18925us total) trans 12884902248 rc 0/0 00000100:00100000:3.0:1779690526.237711:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 105 00000020:00080000:3.0:1779690526.237717:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1779690526.361778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690526.361850:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706368 00000100:00100000:2.0:1779690526.361860:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706368 00000100:00100000:2.0:1779690526.361966:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 750 00000100:00100000:0.0:1779690526.362098:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:107171:x1866137503706368:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690526.362126:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690526.362146:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f405 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf3a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362210:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362234:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362245:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362260:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362266:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362271:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362625:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362634:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362640:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690526.362672:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1779690526.362676:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690526.362693:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362702:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362720:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362726:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362732:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362737:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690526.362741:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362748:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362760:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:0.0:1779690526.362763:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690526.362767:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362772:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f40c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362785:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362791:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362797:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362852:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690526.362855:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362861:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362870:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x46626822 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690526.362872:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690526.362875:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362880:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f413 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362912:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f405 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf3a expref: 60 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362926:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf3a expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.362934:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690526.362936:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690526.362939:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690526.363008:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+59:107171:x1866137503706368:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1018us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690526.363863:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 750 00000100:00100000:2.0:1779690526.371155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690526.371266:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706624 00000100:00100000:1.0:1779690526.371275:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706624 00000100:00100000:1.0:1779690526.371383:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18672 00000100:00100000:1.0:1779690526.371394:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+59:107171:x1866137503706624:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:1.0:1779690526.371408:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690526.371432:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f41a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf3a expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.371450:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:1.0:1779690526.371461:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690526.371529:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:107171:x1866137503706624:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 137us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690526.371536:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18672 00000100:00100000:3.0:1779690526.373696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690526.373907:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706752 00000100:00100000:0.0:1779690526.373929:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706752 00000100:00100000:0.0:1779690526.373972:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 751 00000100:00100000:0.0:1779690526.373981:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+58:107171:x1866137503706752:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:0.0:1779690526.374074:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.374090:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690526.374102:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690526.374405:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].33, 136 off12680 00000100:00100000:0.0:1779690526.374599:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+58:107171:x1866137503706752:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 618us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690526.374607:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 751 00000040:00080000:0.0:1779690526.537025:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690526.537032:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690526.537064:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 34 count 7 00000040:00080000:0.0:1779690526.537071:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690526.537178:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492340480:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690526.537279:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8fc0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1779690526.543424:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492340480:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1779690526.927301:0:69716:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690526.927310:0:69716:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690526.927374:0:69716:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 34 count 7 00000040:00080000:3.0:1779690526.927380:0:69716:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690526.975610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690526.975733:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503706880 00000100:00100000:1.0:1779690526.975743:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503706880 00000100:00100000:1.0:1779690526.975801:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 752 00000100:00100000:1.0:1779690526.975842:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+58:107181:x1866137503706880:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690526.975863:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690526.975882:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f428 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf41 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.975949:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.975963:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.975985:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976003:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976266:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976276:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976669:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976680:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976688:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690526.976727:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1779690526.976731:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690526.976751:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976762:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976771:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976789:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976795:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.976801:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690526.977953:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.977965:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.977979:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:1.0:1779690526.977982:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690526.977988:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.977994:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f42f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978884:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978894:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978902:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978908:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690526.978918:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978924:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978935:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x46626822 (ffff9e2f90442300) 00010000:00010000:1.0:1779690526.978939:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690526.978942:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.978948:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f436 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.979002:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f428 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.979016:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690526.979023:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690526.979025:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690526.979027:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690526.979136:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+59:107181:x1866137503706880:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3295us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690526.979145:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 752 00000100:00100000:1.0:1779690526.992978:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690526.993734:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707136 00000100:00100000:0.0:1779690526.993744:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707136 00000100:00100000:0.0:1779690526.993799:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 753 00000100:00100000:0.0:1779690526.993828:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+59:107181:x1866137503707136:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1779690526.993955:0:57561:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690526.993964:0:57561:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690526.993998:0:57561:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 34 count 7 00000040:00080000:0.0:1779690526.994004:0:57561:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690526.994323:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].34, 136 off12816 00000100:00100000:0.0:1779690526.994405:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+59:107181:x1866137503707136:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 578us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690526.994413:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 753 00010000:00010000:0.0:1779690527.177509:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690527.517526:0:69768:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690527.517534:0:69768:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690527.517598:0:69768:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 35 count 8 00000040:00080000:0.0:1779690527.517604:0:69768:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690527.561103:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690527.561110:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690527.561149:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 35 count 8 00000040:00080000:0.0:1779690527.561156:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690527.561316:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492340608:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690527.561409:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308d7f3540 going to sleep for 11 seconds 00000100:00100000:3.0:1779690527.565183:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492340608:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690528.196778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.196874:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.196893:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690528.197133:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707648 00000100:00100000:2.0:1779690528.197143:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707648 00000100:00100000:2.0:1779690528.197194:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707904 00000100:00100000:2.0:1779690528.197197:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707904 00000100:00100000:2.0:1779690528.197221:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2925 00000100:00100000:2.0:1779690528.197230:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503707648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690528.197300:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503707648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690528.197308:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2925 00000100:00100000:2.0:1779690528.197324:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2926 00000100:00100000:2.0:1779690528.197330:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503707904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690528.197353:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503707904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690528.197358:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2926 00000100:00080000:2.0:1779690528.197386:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690528.197390:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690528.197691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.197731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.197755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.197778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690528.197870:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707520 00000100:00100000:3.0:1779690528.197875:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707520 00000100:00100000:3.0:1779690528.197906:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708032 00000100:00100000:3.0:1779690528.197909:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708032 00000100:00100000:3.0:1779690528.198132:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2927 00000100:00100000:3.0:1779690528.198141:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503707520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690528.198180:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503707520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690528.198186:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2927 00000100:00100000:3.0:1779690528.198200:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2928 00000100:00100000:3.0:1779690528.198207:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503708032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690528.198230:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+7:2389:x1866137503708032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690528.198235:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2928 00000100:00100000:3.0:1779690528.198254:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707392 00000100:00100000:3.0:1779690528.198258:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707392 00000100:00100000:3.0:1779690528.198281:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707776 00000100:00100000:3.0:1779690528.198284:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707776 00000100:00100000:3.0:1779690528.198322:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:3.0:1779690528.198328:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+51:2389:x1866137503707392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690528.198358:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+51:2389:x1866137503707392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690528.198365:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:3.0:1779690528.198377:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00100000:3.0:1779690528.198383:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:2389:x1866137503707776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690528.198406:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:2389:x1866137503707776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690528.198412:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00080000:3.0:1779690528.198437:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690528.198441:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690528.198443:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690528.198687:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503707264 00000100:00100000:2.0:1779690528.198691:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503707264 00000100:00100000:2.0:1779690528.198724:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 183 00000100:00100000:2.0:1779690528.198731:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503707264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690528.198771:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503707264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690528.198777:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 183 00010000:00010000:2.0:1779690528.201285:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690529.226933:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690529.264971:0:69819:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690529.264979:0:69819:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690529.265041:0:69819:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 35 count 8 00000040:00080000:2.0:1779690529.265047:0:69819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:00080000:2.0:1779690529.306862:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902238 is committed 00000001:00080000:2.0:1779690529.306875:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902245 is committed 00000001:00080000:2.0:1779690529.306902:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902248 is committed 00000004:00080000:2.0:1779690529.306909:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:2.0:1779690529.307106:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492340736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1779690529.307169:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690529.307266:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492340736 00000100:00100000:1.0:1779690529.307273:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492340736 00000100:00100000:1.0:1779690529.307378:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6441 00000100:00100000:1.0:1779690529.307396:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492340736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1779690529.307421:0:15940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:493 count 1 00002000:00010000:1.0:1779690529.307466:0:15940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690529.307474:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.307488:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690529.307490:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690529.307495:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.307509:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.307518:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.307525:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.307541:0:15940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1779690529.308033:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492340736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 638us (863us total) trans 4294968347 rc 0/0 00000100:00100000:1.0:1779690529.308041:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6441 00000100:00080000:2.0:1779690529.308100:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1779690529.308130:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e308661a680/2, rc 0, transno 4294968347 00000100:00100000:2.0:1779690529.308135:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492340736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1779690529.309771:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1779690529.309779:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.309792:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690529.309797:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.310687:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.310722:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.310729:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5488b99/0xb4bb873a1913f444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.310749:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690529.310751:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690529.310752:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690529.389088:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.389211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.389254:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708160 00000100:00100000:0.0:1779690529.389263:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708160 00000100:00100000:0.0:1779690529.389310:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708288 00000100:00100000:0.0:1779690529.389313:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708288 00000100:00100000:0.0:1779690529.389332:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 754 00000100:00100000:0.0:1779690529.389341:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503708160:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690529.389371:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690529.389479:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503708160:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690529.389486:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 754 00000100:00100000:0.0:1779690529.389503:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 755 00000100:00100000:0.0:1779690529.389509:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:107207:x1866137503708288:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690529.389519:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690529.389550:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+47:107207:x1866137503708288:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 41us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690529.389571:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 755 00000100:00100000:1.0:1779690529.393178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.397224:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708416 00000100:00100000:0.0:1779690529.397235:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708416 00000100:00100000:0.0:1779690529.397312:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 756 00000100:00100000:0.0:1779690529.397323:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:107206:x1866137503708416:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1779690529.397391:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397408:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397418:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397453:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397460:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397466:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397489:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397497:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397502:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690529.397903:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1779690529.397908:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690529.397931:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397943:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397949:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397957:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397962:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690529.397966:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397973:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397983:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690529.397986:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690529.397990:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.397995:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f44b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398005:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398022:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398028:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398032:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690529.398035:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398041:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398047:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xab983a8e (ffff9e308bf54e00) 00010000:00010000:0.0:1779690529.398049:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690529.398052:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398057:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f452 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xab983a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398070:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398076:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398081:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398085:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690529.398092:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398099:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398107:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690529.398109:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690529.398112:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.398118:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f459 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690529.398193:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+47:107206:x1866137503708416:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 872us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690529.398201:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 756 00000100:00100000:3.0:1779690529.402994:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.403218:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708672 00000100:00100000:0.0:1779690529.403228:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708672 00000100:00100000:0.0:1779690529.403285:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 757 00000100:00100000:0.0:1779690529.403294:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+47:107206:x1866137503708672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690529.403313:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690529.403331:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f460 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf48 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403430:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403452:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403480:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690529.403492:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1779690529.403647:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403655:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403662:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403668:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690529.403672:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403679:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403691:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690529.403693:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690529.403698:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403704:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f467 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403741:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f460 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf48 expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403763:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690529.403765:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690529.403770:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f460 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf48 expref: 49 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.403778:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f800, rc 0) 00000100:00100000:0.0:1779690529.403854:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503708672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 562us (869us total) trans 12884902249 rc 301/301 00000100:00100000:0.0:1779690529.403861:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 757 00000100:00100000:1.0:1779690529.415922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690529.416004:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503708800 00000100:00100000:3.0:1779690529.416014:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503708800 00000100:00100000:3.0:1779690529.416142:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 758 00000100:00100000:3.0:1779690529.416153:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503708800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690529.416186:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x1f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690529.416645:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503708800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690529.416705:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 758 00000100:00100000:3.0:1779690529.427235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690529.427708:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709056 00000100:00100000:1.0:1779690529.427729:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709056 00000100:00100000:1.0:1779690529.427784:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 759 00000100:00100000:1.0:1779690529.427794:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+48:107206:x1866137503709056:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690529.427840:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690529.428374:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f475 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf4f expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.432456:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f47c lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.432476:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f47c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.432490:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f47c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690529.432502:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x20:0x0]: returning size 0 00010000:00010000:1.0:1779690529.432628:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f475 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf4f expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.432648:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f47c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf4f expref: 50 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.432657:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:1.0:1779690529.432660:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690529.432663:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690529.432735:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107206:x1866137503709056:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 4942us (5507us total) trans 12884902250 rc 0/0 00000100:00100000:1.0:1779690529.432745:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 759 00000100:00100000:2.0:1779690529.445416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.445512:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709312 00000100:00100000:0.0:1779690529.445521:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709312 00000100:00100000:0.0:1779690529.445571:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 760 00000100:00100000:0.0:1779690529.445585:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:107206:x1866137503709312:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690529.445642:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690529.445665:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f47c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf4f expref: 50 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.445684:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:0.0:1779690529.445694:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690529.445713:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.445725:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 48 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.445734:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.445773:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 48 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.445786:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 48 pid: 57585 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690529.445799:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492340864:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690529.446024:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209300 going to sleep for 11 seconds 00000100:00100000:0.0:1779690529.448665:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690529.450596:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709440 00000100:00100000:1.0:1779690529.450607:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709440 00010000:00010000:1.0:1779690529.450651:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 49 pid: 57585 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690529.450704:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3268 00000100:00100000:1.0:1779690529.450714:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+49:2391:x1866137503709440:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690529.450728:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690529.450735:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 49 pid: 57585 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.450749:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 49 pid: 57585 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.450772:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:1.0:1779690529.450778:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.450790:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.450798:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.450856:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690529.451030:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f39c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x89:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf17 expref: 49 pid: 57585 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690529.451066:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492340864:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690529.451087:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451095:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451102:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690529.451117:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:2391:x1866137503709440:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 403us (2456us total) trans 0 rc 0/0 00010000:00010000:3.0:1779690529.451123:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690529.451128:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3268 00010000:00010000:3.0:1779690529.451138:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451147:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451399:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451407:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451994:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.451999:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690529.452004:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452080:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452093:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x0 (ffff9e2f826ec400) 00010000:00010000:3.0:1779690529.452096:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690529.452099:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452105:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f48a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452118:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452124:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452129:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452133:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690529.452136:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452141:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452149:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x89:0x0].0x4410e9b1 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690529.452151:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690529.452154:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.452271:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f491 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x89:0x0].0x4410e9b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690529.452495:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+49:107206:x1866137503709312:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 6912us (7083us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690529.452505:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 760 00000100:00100000:0.0:1779690529.458137:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690529.458390:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709568 00000100:00100000:3.0:1779690529.458400:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709568 00000100:00100000:3.0:1779690529.458470:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 761 00000100:00100000:3.0:1779690529.458481:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+49:107206:x1866137503709568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690529.458499:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690529.458526:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f498 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf56 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458557:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f49f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458571:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f49f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458583:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f49f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458678:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f498 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf56 expref: 51 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458697:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266200/0xb4bb873a1913f49f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x20:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf56 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.458706:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f905ad800) 00010000:00010000:3.0:1779690529.458710:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690529.458722:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266200, rc 0) 00000100:00100000:3.0:1779690529.458790:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+50:107206:x1866137503709568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 312us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690529.458799:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 761 00000100:00100000:3.0:1779690529.462630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690529.462835:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709824 00000100:00100000:2.0:1779690529.462851:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709824 00000100:00100000:2.0:1779690529.462933:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 762 00000100:00100000:2.0:1779690529.462947:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107206:x1866137503709824:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1779690529.463057:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690529.463081:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690529.463095:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690529.464283:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed565c4e reply state 0000000052219e7c transno 12884902251 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690529.464299:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690529.464509:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107206:x1866137503709824:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1563us (1883us total) trans 12884902251 rc 0/0 00000100:00100000:2.0:1779690529.464518:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 762 00010000:00010000:3.0:1779690529.472715:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472732:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472740:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472746:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690529.472751:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472758:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472775:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f905ad800) 00010000:00010000:3.0:1779690529.472778:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690529.472783:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.472789:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f4a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690529.473612:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690529.473697:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503709952 00000100:00100000:2.0:1779690529.473715:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503709952 00000100:00100000:2.0:1779690529.473797:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 763 00000100:00100000:2.0:1779690529.473844:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+51:107206:x1866137503709952:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690529.473877:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690529.473904:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f4ad lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf5d expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690529.473995:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f4ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf5d expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690529.474012:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170ca00/0xb4bb873a1913f4ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf5d expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690529.474023:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f905ad800) 00010000:00010000:2.0:1779690529.474027:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690529.474031:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170ca00, rc 0) 00000100:00100000:2.0:1779690529.474106:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107206:x1866137503709952:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 298us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690529.474129:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 763 00000100:00100000:1.0:1779690529.483169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690529.483241:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503710080 00000100:00100000:3.0:1779690529.483257:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503710080 00000100:00100000:3.0:1779690529.483328:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:3.0:1779690529.483356:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107206:x1866137503710080:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1779690529.483541:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107206:x1866137503710080:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 187us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690529.483564:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:1.0:1779690529.487489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690529.487593:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503710336 00000100:00100000:3.0:1779690529.487603:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503710336 00000100:00100000:3.0:1779690529.487655:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:3.0:1779690529.487665:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f9055a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107206:x1866137503710336:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690529.487932:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f9055a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+53:107206:x1866137503710336:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 268us (451us total) trans 12884902252 rc 0/0 00000100:00100000:3.0:1779690529.487940:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:1.0:1779690529.490559:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.490677:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503710592 00000100:00100000:0.0:1779690529.490685:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503710592 00000100:00100000:0.0:1779690529.490739:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 764 00000100:00100000:0.0:1779690529.490749:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:107206:x1866137503710592:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690529.490873:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:107206:x1866137503710592:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 126us (330us total) trans 0 rc -125/-125 00000100:00100000:0.0:1779690529.490881:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 764 00000100:00100000:1.0:1779690529.492866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.493044:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503710848 00000100:00100000:0.0:1779690529.493051:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503710848 00000100:00100000:0.0:1779690529.493093:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:0.0:1779690529.493101:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+53:107206:x1866137503710848:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1779690529.494700:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x20:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1779690529.494827:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.494857:0:57563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.494870:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.494879:0:57563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.494885:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.495362:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690529.498713:0:57563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1779690529.498855:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+54:107206:x1866137503710848:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 5750us (5988us total) trans 12884902253 rc 0/0 00000100:00100000:1.0:1779690529.498866:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 108 00010000:00010000:3.0:1779690529.499726:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690529.499735:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.499746:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690529.499751:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.499761:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.499777:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x20:0x0].0x0 (ffff9e2f905ad800) 00010000:00010000:3.0:1779690529.499780:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690529.499785:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.499791:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f4b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.499830:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690529.499832:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690529.499834:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690529.503399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.503511:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711104 00000100:00100000:0.0:1779690529.503526:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711104 00000100:00100000:0.0:1779690529.503604:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 765 00000100:00100000:0.0:1779690529.503616:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:107206:x1866137503711104:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1779690529.503727:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.503751:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.503765:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.504423:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.504456:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.504464:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.504470:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690529.504475:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505311:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505331:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690529.505334:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690529.505341:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505349:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f421 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505407:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505422:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505430:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505597:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 47 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.505621:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 47 pid: 57560 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690529.505640:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492340992:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690529.505901:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209780 going to sleep for 11 seconds 00000100:00100000:3.0:1779690529.513018:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f93573800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492340992:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690529.513188:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690529.515409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690529.515512:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711232 00000100:00100000:0.0:1779690529.515524:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711232 00010000:00010000:0.0:1779690529.515575:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 48 pid: 57560 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690529.515619:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3269 00000100:00100000:0.0:1779690529.515628:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+48:2392:x1866137503711232:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690529.515644:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690529.515649:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 48 pid: 57560 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515662:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 48 pid: 57560 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515735:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f43d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf41 expref: 48 pid: 57560 timeout: 3357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515752:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690529.515756:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515779:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515786:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690529.515873:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690529.515937:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:2392:x1866137503711232:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 309us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690529.515947:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3269 00010000:00010000:3.0:1779690529.516001:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516010:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516025:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516032:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516039:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516045:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690529.516049:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516116:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516178:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:3.0:1779690529.516181:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690529.516186:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516192:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f4c2 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516205:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516212:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516217:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516223:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690529.516226:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516232:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516239:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x1f:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:3.0:1779690529.516242:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690529.516245:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690529.516250:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f4bb lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690529.516782:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:107206:x1866137503711104:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 13165us (13387us total) trans 12884902254 rc 0/0 00000100:00100000:3.0:1779690529.516792:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 765 00000040:00080000:0.0:1779690529.517144:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690529.517149:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690529.517970:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 8 00000040:00080000:0.0:1779690529.517984:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690530.034706:0:69870:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690530.034714:0:69870:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690530.034768:0:69870:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 35 count 8 00000040:00080000:0.0:1779690530.034773:0:69870:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690530.115041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690530.115458:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711360 00000100:00100000:2.0:1779690530.115468:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711360 00000100:00100000:2.0:1779690530.115529:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 766 00000100:00100000:2.0:1779690530.115539:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711360:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690530.115718:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711360:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 180us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.115726:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 766 00000100:00080000:0.0:1779690530.115791:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690530.122034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690530.122067:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711488 00000100:00100000:0.0:1779690530.122081:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711488 00000100:00100000:0.0:1779690530.122129:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 767 00000100:00100000:0.0:1779690530.122139:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711488:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690530.122345:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690530.122414:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711488:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 272us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690530.122422:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 767 00000100:00100000:1.0:1779690530.127927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690530.128040:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711616 00000100:00100000:0.0:1779690530.128049:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711616 00000100:00100000:0.0:1779690530.128103:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 768 00000100:00100000:0.0:1779690530.128113:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711616:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690530.128270:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690530.128353:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711616:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 242us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690530.128361:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 768 00000100:00100000:1.0:1779690530.131035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690530.131069:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711744 00000100:00100000:1.0:1779690530.131077:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711744 00000100:00100000:1.0:1779690530.131123:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 769 00000100:00100000:1.0:1779690530.131132:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711744:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690530.131275:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690530.131342:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711744:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690530.131350:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 769 00000100:00100000:2.0:1779690530.135624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690530.136366:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503711872 00000100:00100000:1.0:1779690530.136376:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503711872 00000100:00100000:1.0:1779690530.136441:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 770 00000100:00100000:1.0:1779690530.136451:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690530.136556:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503711872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 106us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690530.136565:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 770 00000100:00100000:1.0:1779690530.140829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690530.144597:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712000 00000100:00100000:2.0:1779690530.144609:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712000 00000100:00100000:2.0:1779690530.144658:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 771 00000100:00100000:2.0:1779690530.144667:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1779690530.144828:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 161us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.144835:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 771 00000100:00100000:1.0:1779690530.147613:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690530.148528:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712128 00000100:00100000:2.0:1779690530.148537:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712128 00000100:00100000:2.0:1779690530.148594:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 772 00000100:00100000:2.0:1779690530.148604:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690530.148760:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 158us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.148768:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 772 00000100:00100000:2.0:1779690530.152585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690530.152629:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712256 00000100:00100000:2.0:1779690530.152637:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712256 00000100:00100000:2.0:1779690530.152682:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 773 00000100:00100000:2.0:1779690530.152691:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690530.152863:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:107222:x1866137503712256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 172us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.152871:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 773 00010000:00010000:2.0:1779690530.249112:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690530.761140:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492341120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690530.761367:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690530.761705:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341120 00000100:00100000:0.0:1779690530.761713:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341120 00000100:00100000:0.0:1779690530.761848:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1779690530.761858:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492341120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690530.761892:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619511808 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690530.761947:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492341120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690530.761954:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1779690530.762161:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492341120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1779690530.762255:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690530.762325:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492341376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690530.762325:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492341504:0@lo:400:kworker.0 00000100:00100000:1.0:1779690530.762344:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492341632:0@lo:400:kworker.0 00000100:00100000:3.0:1779690530.762362:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690530.762362:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690530.762383:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690530.762396:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690530.762405:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492341888:0@lo:400:kworker.0 00000100:00100000:1.0:1779690530.762410:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1779690530.762415:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341376 00000100:00100000:1.0:1779690530.762418:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492341248:0@lo:400:kworker.0 00000100:00100000:0.0:1779690530.762418:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341376 00000100:00100000:2.0:1779690530.762565:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690530.762574:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690530.762611:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341504 00000100:00100000:2.0:1779690530.762615:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341504 00000100:00100000:0.0:1779690530.762618:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1779690530.762627:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492341376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690530.762649:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690530.762651:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341632 00000100:00100000:2.0:1779690530.762655:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341632 00000100:00100000:2.0:1779690530.762679:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341888 00000100:00100000:2.0:1779690530.762681:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341888 00000100:00100000:1.0:1779690530.762683:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492341760:0@lo:400:kworker.0 00000100:00100000:0.0:1779690530.762686:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492341376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690530.762694:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1779690530.762698:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1779690530.762707:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690530.762713:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690530.762719:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1779690530.762728:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690530.762755:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492341504:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.762761:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1779690530.762777:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1779690530.762784:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492341888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690530.762790:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492341632:12345-0@lo:400:kworker.0 Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690530.762801:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1779690530.762833:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492341632:0@lo:400:kworker.0 00000100:00100000:2.0:1779690530.762911:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492341888:12345-0@lo:400:kworker.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.762917:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1779690530.762941:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341248 00000100:00100000:2.0:1779690530.762944:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341248 00000100:00100000:2.0:1779690530.762972:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1779690530.762979:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690530.763083:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492341248:0@lo:400:kworker.0 00000100:00100000:2.0:1779690530.763085:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492341248:12345-0@lo:400:kworker.0 Request processed in 105us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.763095:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1779690530.763132:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492341760 00000100:00100000:2.0:1779690530.763135:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492341760 00000100:00100000:2.0:1779690530.763266:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:2.0:1779690530.763274:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492341760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690530.763311:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492341760:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690530.763317:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:1.0:1779690530.763345:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492341760:0@lo:400:kworker.0 00000100:00080000:2.0:1779690530.763387:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690530.763406:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492341888:0@lo:400:kworker.0 00000100:00100000:2.0:1779690530.763416:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492341504:0@lo:400:kworker.0 00000100:00100000:3.0:1779690530.763626:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492341376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1779690531.273965:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690532.299420:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690532.909271:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968347 is committed 00000100:00100000:2.0:1779690533.316130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316387:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316418:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316434:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690533.316502:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712384 00000100:00100000:0.0:1779690533.316587:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712512 00000100:00100000:0.0:1779690533.316958:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712512 00000100:00100000:0.0:1779690533.317010:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712896 00000100:00100000:0.0:1779690533.317013:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712896 00000100:00100000:0.0:1779690533.317036:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:0.0:1779690533.317045:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:2392:x1866137503712512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317113:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:2392:x1866137503712512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317121:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:0.0:1779690533.317136:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:0.0:1779690533.317143:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503712896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317166:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+47:2391:x1866137503712896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317172:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:0.0:1779690533.317204:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712640 00000100:00100000:0.0:1779690533.317208:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712640 00000100:00100000:0.0:1779690533.317228:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713152 00000100:00100000:0.0:1779690533.317231:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713152 00000100:00100000:0.0:1779690533.317247:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503712768 00000100:00100000:0.0:1779690533.317249:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712768 00000100:00100000:0.0:1779690533.317265:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713024 00000100:00100000:0.0:1779690533.317267:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713024 00000100:00100000:0.0:1779690533.317283:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2930 00000100:00100000:0.0:1779690533.317289:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503712640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317325:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503712640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317331:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2930 00000100:00100000:0.0:1779690533.317343:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2931 00000100:00100000:0.0:1779690533.317349:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503713152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317372:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503713152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317377:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2931 00000100:00100000:0.0:1779690533.317388:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2932 00000100:00100000:0.0:1779690533.317393:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503712768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317425:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503712768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317430:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2932 00000100:00100000:0.0:1779690533.317439:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2933 00000100:00100000:0.0:1779690533.317445:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503713024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690533.317466:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503713024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690533.317472:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2933 00000100:00100000:2.0:1779690533.317932:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503712384 00000100:00100000:2.0:1779690533.317966:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00100000:2.0:1779690533.317973:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503712384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690533.318003:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503712384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690533.318009:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00080000:2.0:1779690533.318036:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690533.318040:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690533.318042:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690533.321033:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690533.642142:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690533.642149:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690533.642585:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 35 count 6 00000040:00080000:0.0:1779690533.642592:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690534.234056:0:70068:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.234063:0:70068:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690534.234104:0:70068:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 10 count 2 00000040:00080000:2.0:1779690534.234110:0:70068:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690534.306033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690534.306113:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713280 00000100:00100000:0.0:1779690534.306123:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713280 00000100:00100000:0.0:1779690534.306222:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 774 00000100:00100000:0.0:1779690534.306232:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107668:x1866137503713280:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690534.306274:0:57560:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b394e1c8 uarg=0000000000000000 00000004:00000080:0.0:1779690534.306309:0:57560:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b394e1c8 00000004:00000080:0.0:1779690534.306314:0:57560:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=9, endrec=0 00000040:00080000:0.0:1779690534.306400:0:57560:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690534.306405:0:57560:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690534.306438:0:57560:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl9 endrec = 43 00000040:00080000:0.0:1779690534.306525:0:57560:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 10 count 2 00000040:00080000:0.0:1779690534.306532:0:57560:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690534.306536:0:57560:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl9 entries up to 18446744073709551615 00000040:00080000:0.0:1779690534.306569:0:57560:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690534.306571:0:57560:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690534.307411:0:57560:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 43 count 1 00000040:00080000:0.0:1779690534.307418:0:57560:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690534.307516:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107668:x1866137503713280:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1283us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690534.307526:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 774 00010000:00010000:0.0:1779690534.345022:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690534.373016:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902254 is committed 00000020:00000080:2.0:1779690534.966297:0:70119:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffffc63d850 00000004:00000080:2.0:1779690534.966313:0:70119:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e3082d86000 uarg=0000000000000000 00000004:00000080:2.0:1779690534.966351:0:70119:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e3082d86000 00000004:00000080:2.0:1779690534.966358:0:70119:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=9, endrec=0 00000040:00080000:2.0:1779690534.966468:0:70119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.966473:0:70119:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1779690534.966659:0:70119:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl9 endrec = 43 00000040:00080000:2.0:1779690534.966766:0:70119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 10 count 2 00000040:00080000:2.0:1779690534.966773:0:70119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690534.966939:0:70119:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl9 entries up to 18446744073709551615 00000040:00080000:2.0:1779690534.967064:0:70119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.967067:0:70119:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690534.968610:0:70119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690534.968622:0:70119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1779690534.968658:0:70119:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=9 00000040:00080000:2.0:1779690534.968735:0:70119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.968739:0:70119:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690534.969264:0:70119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 9 count 1 00000040:00080000:2.0:1779690534.969269:0:70119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690534.969290:0:70119:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1779690534.969292:0:70119:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1779690534.969295:0:70119:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl9 record=18446744073709551615 00000040:00080000:2.0:1779690534.969339:0:70119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.969342:0:70119:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690534.971100:0:70119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690534.971113:0:70119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1779690534.971575:0:70119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690534.971579:0:70119:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690534.972332:0:70119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690534.972340:0:70119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690535.370289:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690535.684447:0:70167:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690535.684457:0:70167:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690535.685074:0:70167:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690535.685083:0:70167:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690535.820513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690535.820882:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713408 00000100:00100000:2.0:1779690535.820891:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713408 00000100:00100000:2.0:1779690535.820948:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 775 00000100:00100000:2.0:1779690535.820958:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107104:x1866137503713408:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1779690535.821047:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107104:x1866137503713408:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 89us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690535.821055:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 775 00000100:00080000:2.0:1779690535.821075:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690535.841694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690535.842045:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713664 00000100:00100000:0.0:1779690535.842056:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713664 00000100:00100000:0.0:1779690535.842186:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:0.0:1779690535.842198:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+49:107104:x1866137503713664:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690535.845952:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+50:107104:x1866137503713664:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 3748us (4257us total) trans 12884902255 rc 0/0 00000100:00100000:0.0:1779690535.845965:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:2.0:1779690535.881120:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492342272:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.881131:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690535.881262:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492342400:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.882795:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.882871:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.882936:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492342784:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.882953:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342528:0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.882972:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690535.882989:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.883009:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1779690535.883018:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690535.883022:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492342144:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.883029:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690535.883070:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.883074:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.883102:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492342656:0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.883128:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690535.883452:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342272 00000100:00100000:2.0:1779690535.883461:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342272 00000100:00100000:2.0:1779690535.883508:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342784 00000100:00100000:2.0:1779690535.883511:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342784 00000100:00100000:2.0:1779690535.883529:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1779690535.883600:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492342272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.883652:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492342272:12345-0@lo:400:kworker.0 Request processed in 54us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690535.883659:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1779690535.883676:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1779690535.883682:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492342784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.883709:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492342784:12345-0@lo:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690535.883715:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1779690535.883735:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690535.883766:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492342272:0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.883777:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492342784:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.885598:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342528 00000100:00100000:0.0:1779690535.885607:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342528 00000100:00100000:2.0:1779690535.885668:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690535.885669:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342656 00000100:00100000:0.0:1779690535.885674:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342656 00000100:00100000:2.0:1779690535.885701:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342400 00000100:00100000:0.0:1779690535.885705:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:2.0:1779690535.885708:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342400 00000100:00100000:0.0:1779690535.885716:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.885747:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1779690535.885757:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492342400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.885769:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342528:12345-0@lo:400:kworker.0 Request processed in 55us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690535.885776:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:0.0:1779690535.885791:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1779690535.885797:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690535.885886:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492342400:12345-0@lo:400:kworker.0 Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690535.885892:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1779690535.885934:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492342400:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.885964:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492342656:12345-0@lo:400:kworker.0 Request processed in 165us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690535.885972:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1779690535.885992:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342144 00000100:00100000:0.0:1779690535.885997:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342144 00000100:00100000:0.0:1779690535.886024:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1779690535.886031:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492342144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.886061:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492342144:12345-0@lo:400:kworker.0 Request processed in 31us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690535.886081:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1779690535.886119:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690535.886123:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690535.886125:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690535.886147:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968347 gen 2 00000004:00080000:0.0:1779690535.886153:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e308661a680, transno 4294968347 00000100:00100000:0.0:1779690535.886164:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342528:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.886538:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492342144:0@lo:400:kworker.0 00000100:00100000:0.0:1779690535.886550:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492342656:0@lo:400:kworker.0 00000100:00100000:1.0:1779690535.886688:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342016 00000100:00100000:1.0:1779690535.886693:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342016 00000100:00100000:1.0:1779690535.886730:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492342912 00000100:00100000:1.0:1779690535.886733:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492342912 00000100:00100000:1.0:1779690535.886745:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1779690535.886750:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690535.886774:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619511808 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690535.886844:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690535.886857:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1779690535.886871:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1779690535.886877:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690535.886895:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690535.886920:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492342912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690535.886926:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1779690535.887055:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690535.887067:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492342016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1779690536.392980:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1779690536.967412:0:70215:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 224A: Changelog for remove ============ 02:28:55 (1779690535) 00000100:00100000:2.0:1779690537.260289:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.260598:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503713920 00000100:00100000:0.0:1779690537.260608:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503713920 00000100:00100000:0.0:1779690537.260687:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 776 00000100:00100000:0.0:1779690537.260698:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+50:107870:x1866137503713920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690537.260725:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690537.260840:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf64 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260912:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260926:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260938:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260966:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260973:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.260980:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690537.261592:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690537.262135:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f4de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262149:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f4de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262158:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f4de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690537.262169:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1779690537.262438:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262446:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262452:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262457:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690537.262461:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262667:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262680:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:1.0:1779690537.262682:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690537.262687:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262693:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f4d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262706:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262712:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262718:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262723:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690537.262726:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262731:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262737:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e308bf54e00) 00010000:00010000:1.0:1779690537.262740:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690537.262742:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.262758:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913f4d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.263660:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf64 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.263678:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f4de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf64 expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.263686:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690537.263689:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690537.263692:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690537.263764:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107870:x1866137503713920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3069us (3493us total) trans 12884902256 rc 0/0 00000100:00100000:1.0:1779690537.263773:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 776 00000100:00100000:2.0:1779690537.268343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690537.268485:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714048 00000100:00100000:3.0:1779690537.268493:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714048 00000100:00100000:3.0:1779690537.268549:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18673 00000100:00100000:3.0:1779690537.268558:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2392:x1866137503714048:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690537.268571:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690537.268606:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f4de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf64 expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.268626:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690537.268631:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690537.268848:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+51:2392:x1866137503714048:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 290us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690537.268855:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18673 00000100:00100000:3.0:1779690537.273613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.276651:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714176 00000100:00100000:0.0:1779690537.276667:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714176 00000100:00100000:0.0:1779690537.276737:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 777 00000100:00100000:0.0:1779690537.276748:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+51:107870:x1866137503714176:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690537.276883:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+51:107870:x1866137503714176:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 137us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690537.276891:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 777 00000100:00100000:2.0:1779690537.297782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.297935:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714304 00000100:00100000:0.0:1779690537.297945:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714304 00000100:00100000:0.0:1779690537.298014:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 778 00000100:00100000:0.0:1779690537.298022:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:107871:x1866137503714304:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690537.298040:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690537.298058:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf6b expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298113:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298126:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298150:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298164:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298171:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298177:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298403:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298411:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298417:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298422:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690537.298426:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298434:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298446:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690537.298448:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690537.298453:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298463:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f4f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298474:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298480:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298486:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298491:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690537.298493:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298499:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298505:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690537.298507:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690537.298509:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298514:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f4fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298540:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f4ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf6b expref: 48 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298560:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:0.0:1779690537.298562:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690537.298565:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf6b expref: 48 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.298574:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:0.0:1779690537.298636:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+47:107871:x1866137503714304:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 614us (862us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690537.298643:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 778 00000100:00080000:2.0:1779690537.298764:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690537.306066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690537.306256:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714560 00000100:00100000:1.0:1779690537.306266:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714560 00000100:00100000:1.0:1779690537.306326:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 779 00000100:00100000:1.0:1779690537.306337:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+47:107871:x1866137503714560:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:1.0:1779690537.306399:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690537.306427:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f34f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedefb expref: 47 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.306446:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690537.306451:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690537.306718:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.306737:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.306745:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.306776:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 50 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.306790:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 50 pid: 57585 timeout: 3364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690537.306838:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492343040:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690537.306919:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82ac0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690537.311281:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492343040:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690537.311309:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690537.311788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690537.311895:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714688 00000100:00100000:1.0:1779690537.311903:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714688 00010000:00010000:1.0:1779690537.311935:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 51 pid: 57585 timeout: 3364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690537.311978:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3270 00000100:00100000:1.0:1779690537.311987:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+51:2392:x1866137503714688:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690537.312000:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690537.312006:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 51 pid: 57585 timeout: 3364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312016:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 51 pid: 57585 timeout: 3364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312050:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8000/0xb4bb873a1913f2ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750beded1 expref: 51 pid: 57585 timeout: 3364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312067:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:1.0:1779690537.312072:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312081:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312089:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.312120:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690537.312239:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.312246:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.312271:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.312280:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.312293:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690537.312954:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+50:2392:x1866137503714688:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 965us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690537.312963:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3270 00000004:00200000:2.0:1779690537.313899:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8b:0x0]: returning size 512 00010000:00010000:2.0:1779690537.313911:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313919:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313925:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313930:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.313933:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313941:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313953:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f903c9000) 00010000:00010000:2.0:1779690537.313955:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.313959:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.313965:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f501 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690537.313982:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000db70b173 reply state 000000008502d9d3 transno 12884902257 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690537.314002:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690537.314063:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+48:107871:x1866137503714560:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 7728us (8006us total) trans 12884902257 rc 0/0 00000100:00100000:2.0:1779690537.314070:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 779 00010000:00010000:3.0:1779690537.317149:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317164:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317172:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317178:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690537.317182:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317190:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317220:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690537.317224:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.317228:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.317242:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f508 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690537.321672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.321749:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714816 00000100:00100000:0.0:1779690537.321758:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714816 00000100:00100000:0.0:1779690537.321845:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 780 00000100:00100000:0.0:1779690537.321856:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+47:107872:x1866137503714816:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1779690537.321880:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690537.321901:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f50f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf72 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.321962:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.321975:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.321986:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690537.322052:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690537.322061:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 109 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690537.322133:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.322158:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf72 expref: 49 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.322174:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf72 expref: 48 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.322182:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690537.322185:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690537.322188:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:0.0:1779690537.322261:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+48:107872:x1866137503714816:12345-192.168.203.5@tcp:101:bash.0 Request processed in 406us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690537.322268:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 780 00000100:00100000:1.0:1779690537.324346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690537.324431:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503714944 00000100:00100000:3.0:1779690537.324439:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503714944 00000100:00100000:3.0:1779690537.324492:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 781 00000100:00100000:3.0:1779690537.324500:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:107872:x1866137503714944:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1779690537.324516:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690537.324534:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf79 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324599:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324613:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324623:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324637:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324656:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324662:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324776:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913f532 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324784:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913f532 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324839:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913f532 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690537.324873:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8b:0x0]: returning size 512 00000004:00200000:3.0:1779690537.324877:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690537.324897:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913f532 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324909:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324916:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324922:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324928:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690537.324932:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324939:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324950:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690537.324953:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.324957:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324963:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324988:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.324994:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325000:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325004:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690537.325007:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325012:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325020:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (ffff9e2f905ad300) 00010000:00010000:3.0:1779690537.325022:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.325025:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325030:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f52b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325058:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf79 expref: 50 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325070:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266e00/0xb4bb873a1913f532 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf79 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.325091:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690537.325093:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690537.325096:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266e00, rc 0) 00000100:00100000:3.0:1779690537.325151:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+49:107872:x1866137503714944:12345-192.168.203.5@tcp:101:bash.0 Request processed in 651us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690537.325157:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 781 00000100:00100000:3.0:1779690537.327099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.327177:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715072 00000100:00100000:2.0:1779690537.327186:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715072 00000100:00100000:2.0:1779690537.327235:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 782 00000100:00100000:2.0:1779690537.327244:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+49:107872:x1866137503715072:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690537.327261:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.327277:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f539 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf80 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327330:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327342:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327352:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327423:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327431:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327438:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327513:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327521:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327537:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327543:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.327547:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327554:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327574:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.327578:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.327583:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327590:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f540 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327604:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327610:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327616:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327627:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.327630:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327636:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327773:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690537.327776:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.327779:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327786:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f547 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327904:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f539 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf80 expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327914:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.327916:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.327920:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f539 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf80 expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.327931:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690537.328024:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+49:107872:x1866137503715072:12345-192.168.203.5@tcp:101:bash.0 Request processed in 780us (929us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690537.328031:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 782 00000100:00100000:0.0:1779690537.336546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.336658:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715200 00000100:00100000:2.0:1779690537.336679:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715200 00000100:00100000:2.0:1779690537.336735:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 783 00000100:00100000:2.0:1779690537.336745:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+50:107873:x1866137503715200:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690537.336772:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.336791:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf87 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.336893:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.337077:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.337089:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690537.337147:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690537.337151:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 109 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690537.337173:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.337196:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.337215:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.337223:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:2.0:1779690537.337226:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690537.337230:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690537.337290:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+51:107873:x1866137503715200:12345-192.168.203.5@tcp:101:rm.0 Request processed in 545us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690537.337297:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 783 00000100:00100000:1.0:1779690537.342424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.342502:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715328 00000100:00100000:2.0:1779690537.342511:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715328 00000100:00100000:2.0:1779690537.342569:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 784 00000100:00100000:2.0:1779690537.342578:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:107873:x1866137503715328:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690537.342598:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.342618:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf8e expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342687:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342702:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342713:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342726:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342733:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342739:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342885:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f571 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342906:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342912:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690537.342944:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8b:0x0]: returning size 512 00000004:00200000:2.0:1779690537.342947:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690537.342973:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342984:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342989:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.342995:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343001:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.343005:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343012:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343023:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:2.0:1779690537.343026:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.343030:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343045:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343060:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343066:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343072:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343077:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.343079:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343085:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343092:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690537.343095:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.343098:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343103:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f56a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343134:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf8e expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343159:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c400/0xb4bb873a1913f571 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf8e expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.343166:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.343168:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690537.343171:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c400, rc 0) 00000100:00100000:2.0:1779690537.343221:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+52:107873:x1866137503715328:12345-192.168.203.5@tcp:101:rm.0 Request processed in 644us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690537.343228:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 784 00000100:00100000:0.0:1779690537.348331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.348418:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715456 00000100:00100000:2.0:1779690537.348428:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715456 00000100:00100000:2.0:1779690537.348486:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 785 00000100:00100000:2.0:1779690537.348495:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+52:107873:x1866137503715456:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690537.348514:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.348533:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f578 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf95 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348595:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348610:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348621:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348637:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348664:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348672:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348735:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348743:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348748:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348766:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.348770:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348776:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348788:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.348790:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.348795:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.348799:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f57f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349011:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349024:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349031:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349036:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.349039:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349045:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349053:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690537.349056:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.349058:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349065:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f586 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349098:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f578 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf95 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349108:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.349110:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.349114:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f578 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf95 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.349137:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690537.349185:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+52:107873:x1866137503715456:12345-192.168.203.5@tcp:101:rm.0 Request processed in 691us (862us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690537.349193:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 785 00000100:00100000:0.0:1779690537.353588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690537.353662:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715584 00000100:00100000:3.0:1779690537.353672:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715584 00000100:00100000:3.0:1779690537.353719:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 786 00000100:00100000:3.0:1779690537.353728:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107873:x1866137503715584:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690537.353745:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690537.353770:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f58d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedf9c expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353912:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353926:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353937:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353951:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353959:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.353979:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354040:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354047:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354053:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354058:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690537.354062:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354067:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354075:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690537.354077:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.354081:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354085:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f594 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354092:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354095:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354104:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354107:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690537.354108:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354111:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354115:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f905ad300) 00010000:00010000:3.0:1779690537.354117:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.354118:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354121:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f59b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354144:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f58d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf9c expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354150:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690537.354152:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690537.354154:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f58d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf9c expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690537.354159:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267200, rc 0) 00000100:00100000:3.0:1779690537.354204:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107873:x1866137503715584:12345-192.168.203.5@tcp:101:rm.0 Request processed in 478us (624us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690537.354230:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 786 00000100:00100000:1.0:1779690537.367752:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.369868:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715712 00000100:00100000:2.0:1779690537.369881:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715712 00000100:00100000:2.0:1779690537.369993:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 787 00000100:00100000:2.0:1779690537.370004:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107874:x1866137503715712:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690537.370023:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.370043:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f5a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfa3 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370108:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370123:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370135:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370150:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370157:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370164:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370238:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370245:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370252:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370258:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.370262:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370269:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370281:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.370284:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.370288:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370294:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370319:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370325:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370331:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370343:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.370346:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370352:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370370:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690537.370373:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.370376:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370382:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370417:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f5a2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfa3 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370427:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.370429:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.370434:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f5a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfa3 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.370443:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690537.370550:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107874:x1866137503715712:12345-192.168.203.5@tcp:101:cp.0 Request processed in 548us (2805us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690537.370558:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 787 00000100:00100000:0.0:1779690537.374126:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.374747:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503715840 00000100:00100000:2.0:1779690537.374768:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503715840 00000100:00100000:2.0:1779690537.374943:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 788 00000100:00100000:2.0:1779690537.374955:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107874:x1866137503715840:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690537.374975:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.374995:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f5b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfaa expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375056:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375070:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375081:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375095:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375103:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375109:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375171:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375179:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375185:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375198:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.375202:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375210:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375222:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.375225:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.375229:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375235:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f5be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375251:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375257:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375263:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375268:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.375270:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375277:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375296:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690537.375299:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.375302:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375319:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f5c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375353:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f5b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfaa expref: 53 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375374:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.375376:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.375380:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f5b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfaa expref: 53 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.375390:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d400, rc 0) 00000100:00100000:2.0:1779690537.375455:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107874:x1866137503715840:12345-192.168.203.5@tcp:101:cp.0 Request processed in 503us (1337us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690537.375473:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 788 00000100:00100000:3.0:1779690537.380242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690537.380864:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716096 00000100:00100000:2.0:1779690537.380875:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716096 00000100:00100000:2.0:1779690537.380930:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 789 00000100:00100000:2.0:1779690537.380940:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107874:x1866137503716096:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690537.380959:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690537.380977:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f5cc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfb1 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381115:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381129:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381140:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381154:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381161:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.381167:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690537.382617:0:57559:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ed:0x0], index 1: 0 00010000:00010000:2.0:1779690537.383198:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac200/0xb4bb873a1913f5e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383214:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac200/0xb4bb873a1913f5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383225:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac200/0xb4bb873a1913f5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383260:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383282:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383289:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383294:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690537.383298:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383317:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383330:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690537.383333:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690537.383338:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383344:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f5d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690537.383369:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b531091d reply state 00000000703aab37 transno 12884902258 ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690537.383377:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690537.383410:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f5cc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb1 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383425:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ac200/0xb4bb873a1913f5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb1 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690537.383441:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:2.0:1779690537.383443:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690537.383446:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ac200, rc 0) 00000100:00100000:2.0:1779690537.383545:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:107874:x1866137503716096:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2606us (3311us total) trans 12884902258 rc 0/0 00000100:00100000:2.0:1779690537.383553:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 789 00010000:00010000:1.0:1779690537.386294:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386308:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386315:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386336:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690537.386340:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386348:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386370:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f826ec600) 00010000:00010000:1.0:1779690537.386374:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690537.386378:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.386385:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f5da lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690537.386572:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.387957:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716224 00000100:00100000:0.0:1779690537.387968:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716224 00000100:00100000:0.0:1779690537.388029:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6442 00000100:00100000:0.0:1779690537.388039:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503716224:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690537.388056:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1779690537.388068:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690537.388077:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfb8 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690537.388120:0:22279:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1779690537.388140:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.388142:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.388150:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 11 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.388167:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 11 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.388180:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690537.388293:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503716224:12345-192.168.203.5@tcp:101:cp.0 Request processed in 256us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690537.388300:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6442 00000100:00100000:3.0:1779690537.394236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690537.396440:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716352 00000100:00100000:0.0:1779690537.396452:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716352 00000100:00100000:0.0:1779690537.396524:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6443 00000100:00100000:0.0:1779690537.396534:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+11:107874:x1866137503716352:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690537.396553:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690537.396571:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfbf expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.396601:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.396611:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.396625:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.396629:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.396663:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.396676:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 3364 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690537.396690:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492343168:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690537.396791:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209c00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690537.398598:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492343168:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690537.398630:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 12 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690537.398648:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:1.0:1779690537.398700:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+12:107874:x1866137503716352:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2167us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690537.398708:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6443 00000100:00100000:3.0:1779690537.401619:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690537.401786:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716480 00000100:00100000:1.0:1779690537.401795:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716480 00010000:00010000:0.0:1779690537.403783:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 3364 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690537.404009:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3271 00000100:00100000:0.0:1779690537.404023:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503716480:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690537.404038:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690537.404060:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 3364 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.404074:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 3364 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.404096:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000f12f49/0xb4bb873a1913f5ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfb8 expref: 12 pid: 22279 timeout: 3364 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.404128:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.404130:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690537.404138:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.404148:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690537.404185:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690537.404199:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5781:1866137492343296:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690537.404294:0:5781:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209600 going to sleep for 11 seconds 00000100:00100000:3.0:1779690537.408600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690537.408798:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716736 00000100:00100000:1.0:1779690537.408837:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716736 00000100:00100000:1.0:1779690537.408899:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:1.0:1779690537.408933:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+54:107874:x1866137503716736:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:1.0:1779690537.409254:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107874:x1866137503716736:12345-192.168.203.5@tcp:35:cp.0 Request processed in 333us (661us total) trans 12884902259 rc 0/0 00000100:00100000:1.0:1779690537.409261:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:0.0:1779690537.416324:0:5781:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5781:1866137492343296:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690537.416354:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690537.416424:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503716480:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 12405us (14812us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690537.416434:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3271 00010000:00010000:0.0:1779690537.417344:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690537.737025:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690537.737031:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690537.737590:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 6 00000040:00080000:3.0:1779690537.737598:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690538.435770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690538.435893:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716992 00000100:00100000:1.0:1779690538.435906:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716992 00000100:00100000:1.0:1779690538.435985:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:1.0:1779690538.435995:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:2390:x1866137503716992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690538.436515:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:2390:x1866137503716992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 309us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690538.436532:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:3.0:1779690538.436826:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437710:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690538.437784:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717248 00000100:00100000:3.0:1779690538.437791:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717248 00000100:00100000:3.0:1779690538.437837:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717504 00000100:00100000:3.0:1779690538.437840:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717504 00000100:00100000:3.0:1779690538.437864:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717120 00000100:00100000:3.0:1779690538.437867:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717120 00000100:00100000:3.0:1779690538.437885:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717632 00000100:00100000:3.0:1779690538.437888:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717632 00000100:00100000:3.0:1779690538.437910:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2936 00000100:00100000:3.0:1779690538.437918:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503717248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.437980:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503717248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 63us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.437995:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2936 00000100:00100000:3.0:1779690538.438011:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2937 00000100:00100000:3.0:1779690538.438017:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503717504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.438043:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503717504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.438048:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2937 00000100:00100000:3.0:1779690538.438071:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2938 00000100:00100000:3.0:1779690538.438078:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503717120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.438101:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503717120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.438106:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2938 00000100:00100000:3.0:1779690538.438117:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2939 00000100:00100000:3.0:1779690538.438123:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503717632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.438147:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+7:2390:x1866137503717632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.438153:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2939 00000100:00100000:3.0:1779690538.438174:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503716864 00000100:00100000:3.0:1779690538.438178:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503716864 00000100:00100000:3.0:1779690538.438209:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:3.0:1779690538.438215:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503716864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.438243:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503716864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.438250:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:3.0:1779690538.438290:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717376 00000100:00100000:3.0:1779690538.438293:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717376 00000100:00100000:3.0:1779690538.438325:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00100000:3.0:1779690538.438332:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+49:2390:x1866137503717376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690538.438370:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+49:2390:x1866137503717376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690538.438377:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00080000:3.0:1779690538.438397:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690538.438401:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1779690538.440947:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690538.770540:0:70311:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690538.770547:0:70311:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690538.771183:0:70311:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690538.771192:0:70311:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690539.465281:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1779690539.507835:0:70360:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffd77293a10 00000004:00000080:0.0:1779690539.507850:0:70360:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e30b50a1400 uarg=0000000000000000 00000004:00000080:0.0:1779690539.507900:0:70360:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e30b50a1400 00000040:00080000:0.0:1779690539.508200:0:70360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].10, 80 off8992 00000004:00000080:0.0:1779690539.508222:0:70360:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl10', mask 0x0 00000004:02000000:0.0:1779690539.508226:0:70360:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000001:00080000:3.0:1779690539.535723:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902255 is committed 00000001:00080000:3.0:1779690539.535737:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902259 is committed 00000001:00080000:3.0:1779690539.535751:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902257 is committed 00000100:00100000:0.0:1779690539.595999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.596077:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717760 00000100:00100000:3.0:1779690539.596086:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717760 00000100:00100000:3.0:1779690539.596155:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 790 00000100:00100000:3.0:1779690539.596165:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+48:107914:x1866137503717760:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690539.596187:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690539.596206:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f5fd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfc6 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596268:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596283:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596294:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596325:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596333:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596353:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596698:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596709:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596717:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690539.596750:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x21:0x0]: returning size 1516 00000004:00200000:3.0:1779690539.596755:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690539.596863:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596874:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596882:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596888:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596904:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596911:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690539.596915:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596922:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596933:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:3.0:1779690539.596936:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690539.596940:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596947:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266800/0xb4bb873a1913f604 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596958:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596964:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596969:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596973:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690539.596975:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596990:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.596998:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0xd149d755 (ffff9e2f905ad300) 00010000:00010000:3.0:1779690539.597001:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690539.597004:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.597009:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f60b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.597039:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f5fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfc6 expref: 50 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.597052:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266a00/0xb4bb873a1913f612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfc6 expref: 49 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.597058:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:3.0:1779690539.597060:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690539.597063:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266a00, rc 0) 00000100:00100000:3.0:1779690539.597119:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+49:107914:x1866137503717760:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 956us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690539.597128:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 790 00000100:00080000:0.0:1779690539.597304:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690539.601860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.602071:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503717888 00000100:00100000:1.0:1779690539.602080:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503717888 00000100:00100000:1.0:1779690539.602131:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6444 00000100:00100000:1.0:1779690539.602141:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503717888:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690539.602157:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690539.602175:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfcd expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690539.602233:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492343424:192.168.203.5@tcp:106: 00000100:00100000:1.0:1779690539.602316:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82ac0300 going to sleep for 11 seconds 00002000:00010000:2.0:1779690539.610198:0:15940:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1ed:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1779690539.610205:0:15940:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1ed:0x0] updating lvb mtime: 0 -> 1779690537 00002000:00010000:2.0:1779690539.610207:0:15940:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1ed:0x0] updating lvb atime: 0 -> 1779690537 00002000:00010000:2.0:1779690539.610210:0:15940:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1ed:0x0] updating lvb ctime: 0 -> 1779690537 00000100:00100000:2.0:1779690539.610234:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15940:1866137492343424:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690539.610269:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f619 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfcd expref: 8 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.610293:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f619 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfcd expref: 8 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.610304:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:2.0:1779690539.610496:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503717888:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 8356us (8639us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690539.610505:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6444 00000100:00100000:2.0:1779690539.619917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690539.619954:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718016 00000100:00100000:2.0:1779690539.619969:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718016 00000100:00100000:2.0:1779690539.620019:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 791 00000100:00100000:2.0:1779690539.620030:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+49:107914:x1866137503718016:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690539.620049:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690539.620068:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfd4 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.620133:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913f627 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.620149:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913f627 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.624124:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913f627 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690539.624319:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8b:0x0]: returning size 7680 00000004:00200000:2.0:1779690539.624324:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690539.624420:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913f627 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.624459:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfd4 expref: 51 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.624475:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812adc00/0xb4bb873a1913f627 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfd4 expref: 50 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.624483:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8b:0x0].0x0 (ffff9e2f905ade00) 00010000:00010000:2.0:1779690539.624486:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690539.624489:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812adc00, rc 0) 00000100:00100000:2.0:1779690539.624567:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+50:107914:x1866137503718016:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 4538us (4657us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690539.624576:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 791 00000100:00100000:2.0:1779690539.639941:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690539.640393:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718144 00000100:00100000:0.0:1779690539.640402:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718144 00000100:00100000:0.0:1779690539.640454:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6445 00000100:00100000:0.0:1779690539.640463:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503718144:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690539.640478:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690539.640494:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a83aa3c/0xb4bb873a1913f62e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfdb expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690539.640551:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492343552:192.168.203.5@tcp:106: 00000100:00100000:0.0:1779690539.640635:0:6583:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8d540540 going to sleep for 11 seconds 00000100:00100000:2.0:1779690539.646628:0:6583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492343552:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690539.646666:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a83aa3c/0xb4bb873a1913f62e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfdb expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.646690:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a83aa3c/0xb4bb873a1913f62e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfdb expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.646702:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f800, rc 0) 00000100:00100000:2.0:1779690539.646792:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+7:2391:x1866137503718144:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 6328us (6860us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690539.646801:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6445 00000100:00100000:2.0:1779690539.654960:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.655018:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718400 00000100:00100000:3.0:1779690539.655028:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718400 00000100:00100000:3.0:1779690539.655086:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 792 00000100:00100000:3.0:1779690539.655096:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:107914:x1866137503718400:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690539.655625:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].35, 136 off12952 00000100:00100000:3.0:1779690539.655742:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:107914:x1866137503718400:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 646us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690539.655751:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 792 00000040:00080000:3.0:1779690539.785032:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690539.785039:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690539.785077:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 36 count 7 00000040:00080000:3.0:1779690539.785084:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690539.785627:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492343680:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690539.785780:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f3f5780 going to sleep for 11 seconds 00000100:00100000:3.0:1779690539.792032:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492343680:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690539.794344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.794439:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718528 00000100:00100000:1.0:1779690539.794451:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718528 00000100:00100000:1.0:1779690539.794540:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 793 00000100:00100000:1.0:1779690539.794550:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:107924:x1866137503718528:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690539.794591:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x21:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690539.794687:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:107924:x1866137503718528:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690539.794695:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 793 00000100:00080000:3.0:1779690539.798377:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690539.799484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690539.799595:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718784 00000100:00100000:0.0:1779690539.799605:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718784 00000100:00100000:0.0:1779690539.799657:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 794 00000100:00100000:0.0:1779690539.799667:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+51:107924:x1866137503718784:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690539.799684:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690539.799702:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f635 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfe2 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.799791:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f63c lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.799822:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f63c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.799840:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f63c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690539.799852:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x21:0x0]: returning size 1516 00010000:00010000:0.0:1779690539.799996:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f635 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfe2 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.800013:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f63c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfe2 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.800022:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:0.0:1779690539.800024:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690539.800028:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:0.0:1779690539.800086:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+53:107924:x1866137503718784:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 420us (609us total) trans 12884902260 rc 0/0 00000100:00100000:0.0:1779690539.800094:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 794 00000100:00100000:2.0:1779690539.804926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690539.804969:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.805110:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719040 00000100:00100000:3.0:1779690539.805132:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719040 00000100:00100000:3.0:1779690539.805222:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18674 00000100:00100000:3.0:1779690539.805235:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+53:2391:x1866137503719040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690539.805258:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690539.805293:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f63c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfe2 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.805320:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:3.0:1779690539.805328:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690539.805366:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503718912 00000100:00100000:0.0:1779690539.805379:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503718912 00000100:00100000:3.0:1779690539.805409:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+52:2391:x1866137503719040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690539.805417:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18674 00000100:00100000:0.0:1779690539.805460:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6446 00000100:00100000:0.0:1779690539.805473:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2389:x1866137503718912:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00000100:00080000:3.0:1779690539.805514:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690539.805519:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.805554:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.805575:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690539.805577:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690539.805581:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.805618:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.805632:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 11 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690539.805647:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492343808:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690539.805729:0:22747:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8d540540 going to sleep for 11 seconds 00000100:00100000:2.0:1779690539.816040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690539.816125:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492343808:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690539.816147:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690539.816634:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719168 00000100:00100000:0.0:1779690539.816647:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719168 00002000:00100000:0.0:1779690539.816717:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ed:0x0] (0->1515) req@ffff9e308678f800 x1866137503719168/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:20/0 lens 2008/0 e 0 to 0 dl 1779690550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690539.816729:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678f800 with x1866137503719168 ext(0->1515) 00010000:00010000:0.0:1779690539.816739:0:37637:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 12 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.816758:0:37637:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 12 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690539.816767:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e308678f800 00000100:00100000:0.0:1779690539.816921:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:0.0:1779690539.816934:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503719168:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:0.0:1779690539.817790:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503719168:12345-192.168.203.5@tcp:4:cp.0 Request processed in 850us (1752us total) trans 4294968445 rc 0/0 00000100:00100000:0.0:1779690539.817802:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00002000:00100000:0.0:1779690539.817849:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ed:0x0] (0->1515) req@ffff9e308678f800 x1866137503719168/t4294968445(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:20/0 lens 2008/448 e 0 to 0 dl 1779690550 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690539.817860:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678f800 with x1866137503719168 ext(0->1515) 00010000:00010000:0.0:1779690539.817870:0:37637:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.817898:0:37637:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690539.817907:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e308678f800 00000100:00100000:3.0:1779690539.830220:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.831971:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719296 00000100:00100000:1.0:1779690539.831988:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719296 00010000:00010000:1.0:1779690539.832041:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690539.832146:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3272 00000100:00100000:1.0:1779690539.832158:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503719296:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690539.832185:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690539.832212:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.832228:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.832254:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1913f5f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfbf expref: 14 pid: 15940 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.832272:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690539.832274:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690539.832280:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.832309:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.832355:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690539.832390:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832412:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690539.832435:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503719296:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 277us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690539.832444:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3272 00010000:00010000:2.0:1779690539.832445:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832456:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832465:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832474:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690539.832480:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832510:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832525:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.832533:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d1fb58/0xb4bb873a1913f64a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690539.832610:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+12:2389:x1866137503718912:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 27141us (27696us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690539.832621:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6446 00000100:00100000:1.0:1779690539.835680:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690539.835743:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719552 00000100:00100000:2.0:1779690539.835756:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719552 00000100:00100000:2.0:1779690539.835849:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 795 00000100:00100000:2.0:1779690539.835861:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107924:x1866137503719552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690539.836003:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:107924:x1866137503719552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690539.836012:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 795 00000100:00100000:0.0:1779690539.839404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.839482:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719680 00000100:00100000:1.0:1779690539.839498:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719680 00000100:00100000:1.0:1779690539.839610:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6447 00000100:00100000:1.0:1779690539.839621:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503719680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690539.839642:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690539.839667:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078c8b19e/0xb4bb873a1913f651 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedfe9 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690539.839700:0:22279:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ed:0x0] initial LVB size: 1516, mtime: 0x6a13ec29, atime: 0x0, ctime: 0x6a13ec29, blocks: 0x1 00010000:00010000:1.0:1779690539.839721:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690539.839724:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690539.839732:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078c8b19e/0xb4bb873a1913f651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfe9 expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.839752:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078c8b19e/0xb4bb873a1913f651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedfe9 expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690539.839781:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8000, rc 0) 00000100:00100000:1.0:1779690539.839871:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503719680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 251us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690539.839878:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6447 00000100:00100000:0.0:1779690539.843508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.843606:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503719936 00000100:00100000:1.0:1779690539.843615:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503719936 00000100:00100000:1.0:1779690539.843711:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 796 00000100:00100000:1.0:1779690539.843725:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107924:x1866137503719936:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690539.843876:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:107924:x1866137503719936:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 155us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690539.843885:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 796 00000100:00100000:3.0:1779690539.850732:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690539.851692:0:17754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720064 00000100:00100000:1.0:1779690539.851703:0:17754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720064 00002000:00100000:1.0:1779690539.851747:0:17754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1ed:0x0] (0->4095) req@ffff9e2f8d2c1180 x1866137503720064/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:20/0 lens 488/0 e 0 to 0 dl 1779690550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690539.851758:0:17754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d2c1180 with x1866137503720064 ext(0->4095) 00002000:00010000:1.0:1779690539.851764:0:17754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8d2c1180 00000100:00100000:1.0:1779690539.851790:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2080 00000100:00100000:1.0:1779690539.851799:0:17754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503720064:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1779690539.852045:0:17754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503720064:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 246us (1320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1779690539.852053:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2080 00002000:00100000:1.0:1779690539.852060:0:17754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1ed:0x0] (0->4095) req@ffff9e2f8d2c1180 x1866137503720064/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:20/0 lens 488/4536 e 0 to 0 dl 1779690550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690539.852078:0:17754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d2c1180 with x1866137503720064 ext(0->4095) 00002000:00010000:1.0:1779690539.852082:0:17754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8d2c1180 00000100:00100000:3.0:1779690539.858521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690539.858611:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720192 00000100:00100000:0.0:1779690539.858621:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720192 00000100:00100000:0.0:1779690539.858708:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 797 00000100:00100000:0.0:1779690539.858718:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107924:x1866137503720192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690539.858737:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690539.858758:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f658 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedff0 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858793:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858846:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858859:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858949:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913f658 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858968:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.858976:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:0.0:1779690539.858978:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690539.858983:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f400, rc 0) 00000100:00100000:0.0:1779690539.859049:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:107924:x1866137503720192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 331us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690539.859056:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 797 00000100:00100000:3.0:1779690539.862366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.862401:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720320 00000100:00100000:3.0:1779690539.862409:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720320 00000100:00100000:3.0:1779690539.862941:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 798 00000100:00100000:3.0:1779690539.862954:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:107924:x1866137503720320:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690539.863032:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x21:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690539.863137:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:107924:x1866137503720320:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 185us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690539.863145:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 798 00000100:00100000:1.0:1779690539.867352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.867715:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720448 00000100:00100000:3.0:1779690539.867728:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720448 00000100:00100000:3.0:1779690539.867925:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6448 00000100:00100000:3.0:1779690539.867944:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503720448:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690539.868000:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868020:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690539.868023:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690539.868030:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868048:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868107:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868117:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868127:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868135:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690539.868139:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868150:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868169:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.868177:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690539.868275:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503720448:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 339us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690539.868295:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6448 00000100:00100000:1.0:1779690539.871023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690539.871139:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720704 00000100:00100000:3.0:1779690539.871149:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720704 00000100:00100000:3.0:1779690539.871233:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 799 00000100:00100000:3.0:1779690539.871243:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:107924:x1866137503720704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690539.871317:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.871350:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.871361:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.871394:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690539.871408:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 53 pid: 57559 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690539.871421:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492343936:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690539.871543:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f3f5780 going to sleep for 11 seconds 00000100:00100000:3.0:1779690539.873453:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690539.873566:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503720832 00000100:00100000:2.0:1779690539.873572:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503720832 00010000:00010000:2.0:1779690539.873605:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 54 pid: 57559 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690539.873634:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3273 00000100:00100000:2.0:1779690539.873643:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503720832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690539.873655:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690539.873661:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 54 pid: 57559 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.873673:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 54 pid: 57559 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.873694:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:2.0:1779690539.873706:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.873734:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.873742:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690539.873761:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690539.873829:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503720832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 186us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690539.873836:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3273 00010000:00010000:0.0:1779690539.874154:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913f65f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff0 expref: 53 pid: 57559 timeout: 3367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690539.874170:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492343936:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690539.874187:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.874195:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.874212:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690539.874944:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902261 00010000:00010000:0.0:1779690539.874974:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.874983:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.874990:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.874997:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690539.875000:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.875007:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.875019:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:0.0:1779690539.875022:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690539.875026:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690539.875031:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f66d lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690539.875193:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:107924:x1866137503720704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 3950us (4176us total) trans 12884902262 rc 0/0 00000100:00100000:0.0:1779690539.875210:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 799 00000020:00080000:0.0:1779690539.875215:0:57561:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1779690539.876010:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690539.876015:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690539.877393:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 7 00000040:00080000:3.0:1779690539.877406:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690539.877686:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690539.877929:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503721088 00000100:00100000:0.0:1779690539.877938:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503721088 00000100:00100000:0.0:1779690539.878017:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:0.0:1779690539.878026:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+54:107924:x1866137503721088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690539.878217:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+55:107924:x1866137503721088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 192us (534us total) trans 12884902263 rc 0/0 00000100:00100000:0.0:1779690539.878225:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 111 00000040:00080000:3.0:1779690540.359209:0:70410:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690540.359220:0:70410:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690540.359284:0:70410:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 36 count 7 00000040:00080000:3.0:1779690540.359291:0:70410:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690540.400645:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690540.401575:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503721216 00000100:00100000:3.0:1779690540.401585:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503721216 00000100:00100000:3.0:1779690540.401654:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6449 00000100:00100000:3.0:1779690540.401665:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+7:2392:x1866137503721216:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690540.401685:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690540.401702:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a29187f/0xb4bb873a1913f674 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedff7 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.401726:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690540.401728:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690540.401735:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a29187f/0xb4bb873a1913f674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff7 expref: 8 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.401750:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a29187f/0xb4bb873a1913f674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedff7 expref: 8 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.401763:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266800, rc 0) 00000100:00100000:3.0:1779690540.401835:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503721216:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 171us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690540.401842:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6449 00000100:00080000:0.0:1779690540.403249:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690540.409748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690540.409784:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503721472 00000100:00100000:2.0:1779690540.409793:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503721472 00000100:00100000:2.0:1779690540.409854:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 800 00000100:00100000:2.0:1779690540.409864:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:107925:x1866137503721472:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690540.411500:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].36, 136 off13088 00000100:00100000:2.0:1779690540.411588:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:107925:x1866137503721472:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1723us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690540.411597:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 800 00010000:00010000:3.0:1779690540.491830:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690540.939620:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690540.939627:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690540.939662:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 37 count 8 00000040:00080000:2.0:1779690540.939669:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690540.939785:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f89d25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492344064:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690540.939901:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f953dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690540.950186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690540.950263:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f89d25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492344064:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690540.954457:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503721600 00000100:00100000:1.0:1779690540.954469:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503721600 00000100:00100000:1.0:1779690540.954609:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 801 00000100:00100000:1.0:1779690540.954618:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:107935:x1866137503721600:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690540.954651:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x21:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690540.954752:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:107935:x1866137503721600:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 136us (4574us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690540.954760:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 801 00000100:00100000:2.0:1779690540.959336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690540.959984:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503721856 00000100:00100000:0.0:1779690540.959995:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503721856 00000100:00100000:0.0:1779690540.960073:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 802 00000100:00100000:0.0:1779690540.960083:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:107935:x1866137503721856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690540.960102:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690540.960121:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f67b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bedffe expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690540.960211:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f682 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690540.960226:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690540.960236:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690540.960254:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x21:0x0]: returning size 1516 00010000:00010000:0.0:1779690540.960383:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f67b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedffe expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690540.960399:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f682 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedffe expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690540.960407:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:0.0:1779690540.960410:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690540.960413:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e600, rc 0) 00000100:00100000:0.0:1779690540.960485:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:107935:x1866137503721856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 404us (1166us total) trans 12884902264 rc 0/0 00000100:00100000:0.0:1779690540.960492:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 802 00000100:00100000:1.0:1779690540.970154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690540.976617:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722112 00000100:00100000:3.0:1779690540.976639:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722112 00000100:00100000:3.0:1779690540.976695:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 803 00000100:00100000:3.0:1779690540.976704:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:107935:x1866137503722112:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690540.976778:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.976796:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.976827:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690540.977307:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902265 00010000:00010000:3.0:1779690540.977344:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977354:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977362:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977368:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690540.977372:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977380:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977391:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:3.0:1779690540.977395:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690540.977405:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.977412:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f690 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690540.977538:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:107935:x1866137503722112:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 834us (7388us total) trans 12884902266 rc 0/0 00000100:00100000:3.0:1779690540.977547:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 803 00000020:00080000:3.0:1779690540.977551:0:64445:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1779690540.977656:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690540.977660:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690540.978175:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 8 00000040:00080000:3.0:1779690540.978184:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690540.978334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690540.978413:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722240 00000100:00100000:3.0:1779690540.978419:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722240 00000100:00100000:3.0:1779690540.978748:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18675 00000100:00100000:3.0:1779690540.978757:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503722240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690540.978768:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690540.978784:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f682 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedffe expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690540.978798:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x21:0x0].0x0 (ffff9e2f826ec800) 00010000:00010000:3.0:1779690540.978802:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690540.978946:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+58:2391:x1866137503722240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 190us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690540.978953:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18675 00000040:00080000:1.0:1779690540.985158:0:70461:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690540.985168:0:70461:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690540.985229:0:70461:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 37 count 8 00000040:00080000:1.0:1779690540.985235:0:70461:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690540.989432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690540.989495:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722496 00000100:00100000:3.0:1779690540.989510:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722496 00000100:00100000:3.0:1779690540.989560:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:3.0:1779690540.989571:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+58:107935:x1866137503722496:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690540.989793:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+59:107935:x1866137503722496:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 223us (366us total) trans 12884902267 rc 0/0 00000100:00100000:3.0:1779690540.989801:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:1.0:1779690541.001602:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492344320:0@lo:400:kworker.0 00000100:00100000:3.0:1779690541.001661:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492344576:0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.001672:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690541.001707:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690541.001728:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492344832:0@lo:400:kworker.0 00000100:00100000:0.0:1779690541.001777:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492344192:0@lo:400:kworker.0 00000100:00100000:2.0:1779690541.001861:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344576 00000100:00100000:2.0:1779690541.001870:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344576 00000100:00080000:3.0:1779690541.001913:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690541.001931:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:2.0:1779690541.001940:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492344576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.001991:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690541.002020:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690541.002026:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492344448:0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.002049:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690541.002089:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344320 00000100:00100000:1.0:1779690541.002093:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344320 00000100:00080000:3.0:1779690541.002112:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690541.002133:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344832 00000100:00100000:1.0:1779690541.002137:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344832 00000100:00100000:3.0:1779690541.002141:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344448 00000100:00100000:3.0:1779690541.002146:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344448 00000100:00100000:1.0:1779690541.002167:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1779690541.002176:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492344320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690541.002185:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1779690541.002195:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492344832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.002245:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492344320:12345-0@lo:400:kworker.0 Request processed in 71us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690541.002252:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492344832:12345-0@lo:400:kworker.0 Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690541.002256:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1779690541.002265:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1779690541.002277:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1779690541.002284:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492344448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.002312:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492344448:12345-0@lo:400:kworker.0 Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690541.002317:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1779690541.002956:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690541.002990:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492344704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690541.003018:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690541.003041:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690541.003048:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690541.003082:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690541.003787:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344192 00000100:00100000:0.0:1779690541.003795:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344192 00000100:00100000:0.0:1779690541.003851:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1779690541.003858:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492344192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690541.003911:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492344192:12345-0@lo:400:kworker.0 Request processed in 53us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690541.003917:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1779690541.004083:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492344576:12345-0@lo:400:kworker.0 Request processed in 2143us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690541.004094:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00080000:3.0:1779690541.004103:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690541.004115:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344704 00000100:00100000:2.0:1779690541.004120:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344704 00000100:00100000:1.0:1779690541.004121:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345088 00000100:00100000:1.0:1779690541.004127:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345088 00000100:00100000:3.0:1779690541.004145:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492344576:0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.004165:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1779690541.004170:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00080000:3.0:1779690541.004172:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690541.004177:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492345088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690541.004183:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492344704:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1779690541.004208:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690541.004223:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492344704:12345-0@lo:400:kworker.0 Request processed in 46us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690541.004231:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:1.0:1779690541.004250:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492345088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690541.004258:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1779690541.004281:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492344960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690541.004311:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690541.004370:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492344448:0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.004385:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492344320:0@lo:400:kworker.0 00000100:00100000:2.0:1779690541.004408:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492344960 00000100:00100000:1.0:1779690541.004411:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492344832:0@lo:400:kworker.0 00000100:00100000:2.0:1779690541.004414:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492344960 00000100:00100000:2.0:1779690541.004453:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1779690541.004462:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492344960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690541.004473:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 621608960 pending 1703936 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690541.004518:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492344960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690541.004524:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1779690541.004561:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492344960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690541.004677:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690541.004690:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492344192:0@lo:400:kworker.0 00000100:00100000:0.0:1779690541.004704:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492344704:0@lo:400:kworker.0 00000100:00100000:1.0:1779690541.057057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690541.057157:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722624 00000100:00100000:3.0:1779690541.057167:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722624 00000100:00100000:3.0:1779690541.057266:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 804 00000100:00100000:3.0:1779690541.057276:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722624:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690541.057451:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722624:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 176us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690541.057468:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 804 00000100:00080000:1.0:1779690541.057513:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690541.059445:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690541.059540:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722752 00000100:00100000:1.0:1779690541.059548:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722752 00000100:00100000:1.0:1779690541.059625:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 805 00000100:00100000:1.0:1779690541.059635:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722752:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1779690541.059839:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690541.059893:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722752:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 260us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690541.059901:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 805 00000100:00100000:3.0:1779690541.061904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690541.061944:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503722880 00000100:00100000:0.0:1779690541.061952:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503722880 00000100:00100000:0.0:1779690541.062006:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 806 00000100:00100000:0.0:1779690541.062016:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690541.062156:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690541.062241:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503722880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 226us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690541.062249:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 806 00000100:00100000:1.0:1779690541.065664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690541.066102:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723008 00000100:00100000:3.0:1779690541.066111:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723008 00000100:00100000:3.0:1779690541.066156:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 807 00000100:00100000:3.0:1779690541.066163:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723008:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690541.066285:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690541.066370:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723008:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 206us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690541.066378:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 807 00000100:00100000:3.0:1779690541.068152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690541.068219:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723136 00000100:00100000:1.0:1779690541.068226:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723136 00000100:00100000:1.0:1779690541.068267:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 808 00000100:00100000:1.0:1779690541.068276:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723136:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690541.068370:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723136:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690541.068378:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 808 00000100:00100000:1.0:1779690541.071729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690541.071897:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723264 00000100:00100000:0.0:1779690541.071906:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723264 00000100:00100000:0.0:1779690541.072223:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 809 00000100:00100000:0.0:1779690541.072234:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723264:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690541.072396:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723264:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 163us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690541.072404:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 809 00000100:00100000:2.0:1779690541.076624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690541.076702:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723392 00000100:00100000:3.0:1779690541.076711:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723392 00000100:00100000:3.0:1779690541.076774:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 810 00000100:00100000:3.0:1779690541.076784:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723392:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690541.077014:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723392:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 231us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690541.077022:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 810 00000100:00100000:2.0:1779690541.079352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690541.079416:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723520 00000100:00100000:3.0:1779690541.079425:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723520 00000100:00100000:3.0:1779690541.079484:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 811 00000100:00100000:3.0:1779690541.079494:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723520:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690541.079741:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:107941:x1866137503723520:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 248us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690541.080993:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 811 00010000:00010000:1.0:1779690541.513299:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690542.536959:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690543.051098:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690543.051106:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690543.051141:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 37 count 8 00000040:00080000:0.0:1779690543.051158:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690543.558034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690543.558133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690543.558182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690543.558217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690543.558234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690543.558249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690543.558316:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724032 00000100:00100000:3.0:1779690543.558325:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724032 00000100:00100000:3.0:1779690543.558379:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724288 00000100:00100000:3.0:1779690543.558382:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724288 00000100:00100000:3.0:1779690543.558398:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723904 00000100:00100000:3.0:1779690543.558401:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723904 00000100:00100000:3.0:1779690543.558424:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2942 00000100:00100000:3.0:1779690543.558433:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503724032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690543.558506:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503724032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.558513:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2942 00000100:00100000:3.0:1779690543.558530:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2943 00000100:00100000:3.0:1779690543.558536:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503724288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690543.558559:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503724288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.558565:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2943 00000100:00100000:3.0:1779690543.558576:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2944 00000100:00100000:3.0:1779690543.558582:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503723904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690543.558600:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503723904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 19us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.558605:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2944 00000100:00100000:3.0:1779690543.558621:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723648 00000100:00100000:3.0:1779690543.558624:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723648 00000100:00100000:3.0:1779690543.558644:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:3.0:1779690543.558656:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503723648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690543.558676:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503723648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.558681:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00080000:3.0:1779690543.558709:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690543.558712:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690543.562321:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503723776 00000100:00100000:0.0:1779690543.562335:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503723776 00000100:00100000:3.0:1779690543.563683:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724160 00000100:00100000:3.0:1779690543.563693:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724160 00000100:00100000:3.0:1779690543.563777:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 254 00000100:00100000:3.0:1779690543.563787:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:2391:x1866137503724160:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690543.563891:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:2391:x1866137503724160:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 106us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.563898:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 254 00000100:00080000:1.0:1779690543.563919:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690543.563969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690543.564112:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:3.0:1779690543.564119:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503723776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1779690543.564135:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690543.564154:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503723776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690543.564161:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:0.0:1779690543.564872:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724416 00000100:00100000:0.0:1779690543.564879:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724416 00000100:00100000:0.0:1779690543.564924:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2945 00000100:00100000:0.0:1779690543.564932:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2391:x1866137503724416:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690543.564971:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2391:x1866137503724416:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690543.564976:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2945 00000100:00080000:0.0:1779690543.565056:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1779690543.569418:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690544.586432:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690544.639979:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968445 is committed 00000001:00080000:3.0:1779690544.650281:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902264 is committed 00000001:00080000:3.0:1779690544.650325:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902267 is committed 00000040:00080000:2.0:1779690545.267756:0:70662:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690545.267762:0:70662:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690545.267802:0:70662:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 11 count 2 00000040:00080000:2.0:1779690545.267935:0:70662:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1779690545.344846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690545.346915:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724544 00000100:00100000:2.0:1779690545.346928:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724544 00000100:00100000:2.0:1779690545.347030:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 812 00000100:00100000:2.0:1779690545.347040:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:108382:x1866137503724544:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:2.0:1779690545.347083:0:57585:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b3953408 uarg=0000000000000000 00000004:00000080:2.0:1779690545.347118:0:57585:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b3953408 00000004:00000080:2.0:1779690545.347124:0:57585:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=10, endrec=0 00000040:00080000:2.0:1779690545.347201:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690545.347206:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1779690545.347239:0:57585:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl10 endrec = 48 00000040:00080000:2.0:1779690545.347347:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 11 count 2 00000040:00080000:2.0:1779690545.347353:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690545.347358:0:57585:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl10 entries up to 18446744073709551615 00000040:00080000:2.0:1779690545.347386:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690545.347388:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690545.348018:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 48 count 1 00000040:00080000:2.0:1779690545.348024:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:2.0:1779690545.348118:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+51:108382:x1866137503724544:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1077us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690545.348128:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 812 00000100:00080000:3.0:1779690545.349153:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690545.609211:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1779690545.916755:0:70710:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffdbde9cd20 00000004:00000080:0.0:1779690545.916771:0:70710:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e30901cc000 uarg=0000000000000000 00000004:00000080:0.0:1779690545.916921:0:70710:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e30901cc000 00000004:00000080:0.0:1779690545.916928:0:70710:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=10, endrec=0 00000040:00080000:0.0:1779690545.917029:0:70710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690545.917034:0:70710:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690545.917063:0:70710:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl10 endrec = 48 00000040:00080000:0.0:1779690545.917126:0:70710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 11 count 2 00000040:00080000:0.0:1779690545.917132:0:70710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690545.917178:0:70710:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl10 entries up to 18446744073709551615 00000040:00080000:0.0:1779690545.917222:0:70710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690545.917338:0:70710:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690545.917959:0:70710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:0.0:1779690545.917966:0:70710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:0.0:1779690545.917998:0:70710:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=10 00000040:00080000:0.0:1779690545.918052:0:70710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690545.918055:0:70710:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690545.918368:0:70710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 10 count 1 00000040:00080000:0.0:1779690545.918373:0:70710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690545.918396:0:70710:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1779690545.918397:0:70710:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:0.0:1779690545.918400:0:70710:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl10 record=18446744073709551615 00000040:00080000:0.0:1779690545.918442:0:70710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690545.918445:0:70710:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690545.919453:0:70710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:0.0:1779690545.919463:0:70710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:0.0:1779690545.919556:0:70710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690545.919559:0:70710:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690545.920162:0:70710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690545.920169:0:70710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1779690546.121071:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492345344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.121134:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690546.121175:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492345856:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.121197:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690546.121220:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1779690546.121226:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492345472:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.121248:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690546.121263:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492345984:0@lo:400:kworker.0 00000100:00100000:1.0:1779690546.121307:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690546.121340:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690546.121357:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690546.121381:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345728:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.121401:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345344 00000100:00100000:2.0:1779690546.121409:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345344 00000100:00100000:1.0:1779690546.121409:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690546.121434:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690546.121445:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492345600:0@lo:400:kworker.0 00000100:00100000:0.0:1779690546.121449:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345216 00000100:00100000:2.0:1779690546.121452:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1779690546.121454:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345216 00000100:00100000:2.0:1779690546.121462:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690546.121473:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690546.121498:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1779690546.121505:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492345216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690546.121512:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345472 00000100:00100000:2.0:1779690546.121516:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492345344:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690546.121518:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345472 00000100:00100000:2.0:1779690546.121526:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00002000:00000024:0.0:1779690546.121537:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690546.121564:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345856 00000100:00100000:1.0:1779690546.121564:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345984 00000100:00100000:1.0:1779690546.121568:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345984 00000100:00100000:2.0:1779690546.121570:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345856 00000100:00100000:0.0:1779690546.121576:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492345216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690546.121582:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1779690546.121602:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345600 00000100:00100000:2.0:1779690546.121604:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492345728 00000100:00100000:1.0:1779690546.121606:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345600 00000100:00100000:2.0:1779690546.121609:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492345728 00000100:00100000:1.0:1779690546.121634:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1779690546.121644:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492345472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.121650:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1779690546.121659:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492345856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690546.121665:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:0.0:1779690546.121672:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690546.121688:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492345472:12345-0@lo:400:kworker.0 Request processed in 46us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690546.121695:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1779690546.121701:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492345856:12345-0@lo:400:kworker.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690546.121701:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492345728:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690546.121708:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1779690546.121713:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1779690546.121720:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492345984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690546.121757:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1779690546.121757:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492345984:12345-0@lo:400:kworker.0 Request processed in 36us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690546.121769:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1779690546.121774:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492345600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690546.121835:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492345600:12345-0@lo:400:kworker.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690546.121849:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1779690546.121955:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690546.121969:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492345728:0@lo:400:kworker.0 00000100:00100000:1.0:1779690546.122000:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492345600:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.122374:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1779690546.123776:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492345472:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.123823:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492345984:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.123834:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492345344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690546.123844:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492345856:0@lo:400:kworker.0 00000100:00080000:3.0:1779690546.124019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690546.124025:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690546.124028:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690546.124128:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492346112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690546.124181:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690546.124546:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492346112 00000100:00100000:2.0:1779690546.124553:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492346112 00000100:00100000:2.0:1779690546.124600:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1779690546.124609:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492346112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690546.124643:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690546.124694:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492346112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690546.124701:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1779690546.125022:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492346112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1779690546.600199:0:70758:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690546.600208:0:70758:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690546.602207:0:70758:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690546.602224:0:70758:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1779690546.636649:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690546.717987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690546.718099:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724672 00000100:00100000:1.0:1779690546.718108:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724672 00000100:00100000:1.0:1779690546.718158:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 813 00000100:00100000:1.0:1779690546.718166:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+51:107870:x1866137503724672:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1779690546.718273:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+51:107870:x1866137503724672:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690546.718281:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 813 00000100:00100000:3.0:1779690546.736253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690546.736294:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503724928 00000100:00100000:3.0:1779690546.736303:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503724928 00000100:00100000:3.0:1779690546.736348:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:3.0:1779690546.736357:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+51:107870:x1866137503724928:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690546.737000:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:107870:x1866137503724928:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 418us (530us total) trans 12884902268 rc 0/0 00000100:00100000:3.0:1779690546.737011:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00010000:00010000:1.0:1779690547.657953:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1779690548.034520:0:70806:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 224a: Changelog for failed remove ===== 02:29:06 (1779690546) 00000100:00100000:0.0:1779690548.275883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.276268:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725184 00000100:00100000:3.0:1779690548.276278:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725184 00000100:00100000:3.0:1779690548.276364:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 814 00000100:00100000:3.0:1779690548.276376:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+52:108584:x1866137503725184:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690548.276398:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.276470:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f697 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee005 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276564:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276579:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276589:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276603:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276609:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.276616:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277217:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277228:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277235:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690548.277244:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1779690548.277388:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1779690548.277553:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690548.277594:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277601:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277606:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.277610:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277618:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277629:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:3.0:1779690548.277632:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.277636:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277642:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f69e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277654:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277659:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277665:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277670:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.277677:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277683:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277691:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f905ad000) 00010000:00010000:3.0:1779690548.277693:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.277696:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.277702:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.278186:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f697 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee005 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.278200:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee005 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.278206:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690548.278208:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.278211:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.278325:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108584:x1866137503725184:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1952us (2450us total) trans 12884902269 rc 0/0 00000100:00100000:3.0:1779690548.278333:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 814 00000100:00100000:3.0:1779690548.285047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.285447:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725312 00000100:00100000:2.0:1779690548.285457:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725312 00000100:00100000:2.0:1779690548.285513:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 815 00000100:00100000:2.0:1779690548.285523:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:108584:x1866137503725312:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690548.285691:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:108584:x1866137503725312:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 169us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690548.285707:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 815 00000100:00100000:2.0:1779690548.288970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.289043:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725440 00000100:00100000:3.0:1779690548.289051:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725440 00000100:00100000:3.0:1779690548.289105:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18676 00000100:00100000:3.0:1779690548.289128:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+54:2390:x1866137503725440:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690548.289143:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690548.289166:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee005 expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.289184:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:3.0:1779690548.289189:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690548.289242:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+53:2390:x1866137503725440:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.289258:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18676 00000100:00100000:0.0:1779690548.296603:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.296749:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725568 00000100:00100000:3.0:1779690548.296759:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725568 00000100:00100000:3.0:1779690548.296862:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 816 00000100:00100000:3.0:1779690548.296874:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:108585:x1866137503725568:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690548.296892:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.296911:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee00c expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.296982:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.296998:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297010:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297023:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297043:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297050:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297333:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297341:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297349:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297355:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.297359:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297367:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297379:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690548.297382:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.297386:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297392:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f6c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297404:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297416:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297422:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297427:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.297430:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297436:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297444:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690548.297446:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.297448:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297454:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297485:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee00c expref: 51 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297494:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690548.297496:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.297499:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee00c expref: 51 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.297517:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.297583:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+50:108585:x1866137503725568:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 712us (988us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690548.297590:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 816 00000100:00080000:0.0:1779690548.297830:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690548.303056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.303137:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725824 00000100:00100000:3.0:1779690548.303146:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725824 00000100:00100000:3.0:1779690548.303212:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 817 00000100:00100000:3.0:1779690548.303222:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+50:108585:x1866137503725824:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1779690548.303288:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690548.303313:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913f516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf72 expref: 50 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.303330:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690548.303335:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690548.303604:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.303618:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.303626:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.303658:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.303670:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 52 pid: 57560 timeout: 3375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690548.303691:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492346240:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690548.304082:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8206c240 going to sleep for 11 seconds 00000100:00100000:1.0:1779690548.306681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.307216:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492346240:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690548.307239:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690548.309279:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503725952 00000100:00100000:0.0:1779690548.309291:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503725952 00010000:00010000:0.0:1779690548.309332:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 53 pid: 57560 timeout: 3375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690548.309375:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3274 00000100:00100000:0.0:1779690548.309385:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+53:2392:x1866137503725952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690548.309399:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690548.309405:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 53 pid: 57560 timeout: 3375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309417:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 53 pid: 57560 timeout: 3375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309544:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f555 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedf87 expref: 53 pid: 57560 timeout: 3375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309563:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:0.0:1779690548.309569:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309578:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309584:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.309784:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690548.309920:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2392:x1866137503725952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 535us (3243us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690548.309928:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3274 00010000:00010000:3.0:1779690548.309991:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.310000:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.310030:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.310040:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.310048:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690548.311451:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8c:0x0]: returning size 512 00010000:00010000:3.0:1779690548.311462:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311471:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311476:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311487:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.311491:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311498:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311509:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308bf54a00) 00010000:00010000:3.0:1779690548.311512:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.311516:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.311521:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f6cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690548.311537:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000663096c7 reply state 000000005aa36dcd transno 12884902270 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690548.311545:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1779690548.312123:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+51:108585:x1866137503725824:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 8899us (9071us total) trans 12884902270 rc 0/0 00000100:00100000:3.0:1779690548.312133:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 817 00010000:00010000:3.0:1779690548.319056:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319072:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319079:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319102:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.319107:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319114:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319129:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690548.319132:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.319141:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.319148:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f6d6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690548.321119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.321204:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726080 00000100:00100000:2.0:1779690548.321214:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726080 00000100:00100000:2.0:1779690548.321288:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 818 00000100:00100000:2.0:1779690548.321299:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+50:108586:x1866137503726080:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690548.321322:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690548.321343:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f6dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee013 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321412:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321426:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321437:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690548.321496:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690548.321501:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 110 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690548.321526:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321564:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee013 expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321583:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee013 expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.321601:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:2.0:1779690548.321604:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690548.321615:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:2.0:1779690548.321677:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+51:108586:x1866137503726080:12345-192.168.203.5@tcp:101:bash.0 Request processed in 380us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690548.321692:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 818 00000100:00100000:0.0:1779690548.323772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.323863:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726208 00000100:00100000:2.0:1779690548.323870:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726208 00000100:00100000:2.0:1779690548.323929:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 819 00000100:00100000:2.0:1779690548.323948:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:108586:x1866137503726208:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690548.323965:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690548.323983:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f6eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee01a expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324037:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324048:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324058:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324072:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324078:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324084:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324188:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f700 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324211:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324219:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690548.324266:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8c:0x0]: returning size 512 00000004:00200000:2.0:1779690548.324270:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690548.324292:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324303:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324309:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324315:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324321:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.324325:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324332:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324343:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:2.0:1779690548.324346:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.324350:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324366:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324380:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324670:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324676:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324681:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.324684:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324690:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324699:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (ffff9e308a642b00) 00010000:00010000:2.0:1779690548.324701:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.324704:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324710:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f6f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324743:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f6eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee01a expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324768:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170de00/0xb4bb873a1913f700 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee01a expref: 52 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.324775:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.324778:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690548.324780:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170de00, rc 0) 00000100:00100000:2.0:1779690548.324901:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:108586:x1866137503726208:12345-192.168.203.5@tcp:101:bash.0 Request processed in 963us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690548.324909:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 819 00000100:00100000:1.0:1779690548.333172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.333263:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726336 00000100:00100000:3.0:1779690548.333274:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726336 00000100:00100000:3.0:1779690548.333335:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 820 00000100:00100000:3.0:1779690548.333346:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+52:108586:x1866137503726336:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1779690548.333364:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.333385:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f707 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee021 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333591:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333607:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333639:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333719:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333728:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333734:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.333992:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334001:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334007:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334013:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.334017:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334024:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334035:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.334038:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.334042:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334056:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f70e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334070:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334076:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334081:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334086:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.334089:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334095:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334103:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690548.334105:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.334109:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334115:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f715 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334148:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f707 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee021 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334171:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.334173:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.334178:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f707 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee021 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.334188:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.334297:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+52:108586:x1866137503726336:12345-192.168.203.5@tcp:101:bash.0 Request processed in 952us (1132us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690548.334304:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 820 00000100:00100000:2.0:1779690548.348800:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.349015:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726464 00000100:00100000:3.0:1779690548.349025:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726464 00000100:00100000:3.0:1779690548.349087:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 821 00000100:00100000:3.0:1779690548.349097:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:108587:x1866137503726464:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690548.349117:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.349136:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee028 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349194:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349208:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349220:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690548.349289:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690548.349302:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 110 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690548.349331:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349354:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349371:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.349377:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:3.0:1779690548.349380:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690548.349383:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:3.0:1779690548.349573:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:108587:x1866137503726464:12345-192.168.203.5@tcp:101:rm.0 Request processed in 477us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.349580:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 821 00000100:00100000:0.0:1779690548.352617:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.352676:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726592 00000100:00100000:2.0:1779690548.352685:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726592 00000100:00100000:2.0:1779690548.352741:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 822 00000100:00100000:2.0:1779690548.352751:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:108587:x1866137503726592:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690548.352769:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690548.352788:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee02f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.352864:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.352879:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.352890:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.352923:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.352930:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353215:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353339:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f73f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353349:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f73f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353356:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f73f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690548.353388:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8c:0x0]: returning size 512 00000004:00200000:2.0:1779690548.353392:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690548.353415:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f73f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353704:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353711:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353717:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353734:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.353737:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353744:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353755:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:2.0:1779690548.353758:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.353762:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353767:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353782:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353787:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353793:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353798:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.353800:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353828:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353846:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (ffff9e308a642b00) 00010000:00010000:2.0:1779690548.353849:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.353852:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353857:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353889:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee02f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353901:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d400/0xb4bb873a1913f73f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee02f expref: 54 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.353909:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.353911:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690548.353913:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d400, rc 0) 00000100:00100000:2.0:1779690548.353979:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:108587:x1866137503726592:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1230us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690548.353988:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 822 00000100:00100000:1.0:1779690548.361576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.361725:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726720 00000100:00100000:3.0:1779690548.361735:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726720 00000100:00100000:3.0:1779690548.361894:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 823 00000100:00100000:3.0:1779690548.361905:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108587:x1866137503726720:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690548.361925:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.361944:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f746 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee036 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362006:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362021:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362050:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362065:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362072:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362079:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362134:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362141:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362147:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362153:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.362157:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362164:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362181:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.362184:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.362189:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362201:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f74d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362215:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362220:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362226:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362232:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.362234:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362240:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362256:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690548.362258:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.362261:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362267:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f754 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362295:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f746 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee036 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362314:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.362317:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.362321:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f746 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee036 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.362329:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.362379:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108587:x1866137503726720:12345-192.168.203.5@tcp:101:rm.0 Request processed in 476us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690548.362387:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 823 00000100:00100000:1.0:1779690548.366553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.366674:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726848 00000100:00100000:2.0:1779690548.366683:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726848 00000100:00100000:2.0:1779690548.366739:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 824 00000100:00100000:2.0:1779690548.366748:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:108587:x1866137503726848:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690548.366767:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690548.366783:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f75b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee03d expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366905:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366920:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366932:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366946:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366953:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.366959:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367022:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367029:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367036:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367041:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.367046:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367063:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367074:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.367077:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.367082:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367088:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f762 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367102:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367107:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367112:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367117:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.367119:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367125:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367132:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e308a642b00) 00010000:00010000:2.0:1779690548.367134:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.367137:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367149:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f769 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367181:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f75b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee03d expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367191:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.367193:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.367196:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f75b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee03d expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.367205:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690548.367270:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:108587:x1866137503726848:12345-192.168.203.5@tcp:101:rm.0 Request processed in 522us (724us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690548.367277:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 824 00000100:00100000:1.0:1779690548.389420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690548.390129:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503726976 00000100:00100000:2.0:1779690548.390139:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503726976 00000100:00100000:2.0:1779690548.390199:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 825 00000100:00100000:2.0:1779690548.390209:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:108588:x1866137503726976:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690548.390229:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690548.390264:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f770 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee044 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390328:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390342:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390368:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390384:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390391:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390398:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390473:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390482:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390488:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390494:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.390498:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390504:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390515:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.390518:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.390522:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390534:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f777 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390547:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390553:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390558:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390563:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170c600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690548.390566:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390572:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390579:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e308a642b00) 00010000:00010000:2.0:1779690548.390582:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.390597:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390603:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f77e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390634:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f770 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee044 expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390656:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690548.390658:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690548.390662:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f770 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee044 expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690548.390671:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690548.390892:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:108588:x1866137503726976:12345-192.168.203.5@tcp:101:cp.0 Request processed in 683us (1491us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690548.390900:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 825 00000100:00100000:1.0:1779690548.393244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.398005:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503727104 00000100:00100000:3.0:1779690548.398019:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503727104 00000100:00100000:3.0:1779690548.398091:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 826 00000100:00100000:3.0:1779690548.398101:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108588:x1866137503727104:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690548.398119:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.398137:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f785 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee04b expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398391:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398407:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398417:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398430:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398450:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398457:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398516:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398523:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398529:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398535:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.398539:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398546:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398557:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.398560:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.398564:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398570:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f78c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398582:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398593:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398599:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398603:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690548.398606:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398611:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398618:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690548.398620:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.398622:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398628:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f793 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398655:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f785 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee04b expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398664:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690548.398666:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690548.398669:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f785 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee04b expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.398685:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.398737:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108588:x1866137503727104:12345-192.168.203.5@tcp:101:cp.0 Request processed in 638us (5499us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690548.398743:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 826 00000100:00100000:1.0:1779690548.409088:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690548.409178:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503727360 00000100:00100000:0.0:1779690548.409188:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503727360 00000100:00100000:0.0:1779690548.409255:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 827 00000100:00100000:0.0:1779690548.409280:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:108588:x1866137503727360:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690548.409300:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690548.409319:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f79a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee052 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409444:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409460:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409473:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409487:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409493:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.409516:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690548.411039:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ee:0x0], index 0: 0 00010000:00010000:0.0:1779690548.411218:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411232:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411242:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411801:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411897:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411904:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411910:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690548.411914:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411921:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411935:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:0.0:1779690548.411938:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690548.411952:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.411958:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913f7a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690548.411973:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004bf5046d reply state 00000000abc60c1c transno 12884902271 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690548.411982:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690548.412020:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913f79a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.412034:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690548.412041:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690548.412044:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690548.412046:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ec00, rc 0) 00000100:00100000:0.0:1779690548.412168:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:108588:x1866137503727360:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2890us (3087us total) trans 12884902271 rc 0/0 00000100:00100000:0.0:1779690548.412176:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 827 00010000:00010000:1.0:1779690548.418873:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418892:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418899:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418905:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690548.418925:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418933:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418950:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690548.418953:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690548.418958:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.418964:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913f7a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690548.421584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.421840:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503727488 00000100:00100000:3.0:1779690548.421850:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503727488 00000100:00100000:3.0:1779690548.421909:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6450 00000100:00100000:3.0:1779690548.421920:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503727488:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690548.421937:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690548.421957:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee059 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690548.421982:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690548.421999:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690548.422001:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690548.422009:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 8 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.422024:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 8 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690548.422036:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690548.422149:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503727488:12345-192.168.203.5@tcp:101:cp.0 Request processed in 232us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.422156:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6450 00000100:00080000:0.0:1779690548.422286:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690548.425319:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690548.425750:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503727616 00000100:00100000:1.0:1779690548.425760:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503727616 00000100:00100000:1.0:1779690548.425829:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6451 00000100:00100000:1.0:1779690548.425840:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:108588:x1866137503727616:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690548.425858:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690548.425876:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee060 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.425905:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.425914:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690548.425916:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690548.425920:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 9 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.425969:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.425981:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 3375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690548.425995:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492346368:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690548.426081:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447b780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690548.428737:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492346368:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690548.428770:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 9 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.428791:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:1.0:1779690548.428871:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:108588:x1866137503727616:12345-192.168.203.5@tcp:101:cp.0 Request processed in 3032us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690548.428879:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6451 00000100:00100000:2.0:1779690548.431003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690548.431721:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503727744 00000100:00100000:1.0:1779690548.431730:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503727744 00010000:00010000:1.0:1779690548.431772:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 3375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690548.431844:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3275 00000100:00100000:1.0:1779690548.431855:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503727744:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690548.431886:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690548.431908:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 3375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.431921:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 3375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.431945:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024613461/0xb4bb873a1913f7bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee059 expref: 9 pid: 6581 timeout: 3375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.431959:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690548.431961:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690548.431968:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.431978:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690548.432015:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690548.432030:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492346496:192.168.203.5@tcp:105: 00000100:00100000:1.0:1779690548.432115:0:5780:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447b780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690548.437054:0:5780:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5780:1866137492346496:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690548.437080:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690548.437151:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503727744:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 5296us (6154us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690548.437161:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3275 00000100:00100000:2.0:1779690548.438450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.438598:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728000 00000100:00100000:3.0:1779690548.438605:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728000 00000100:00100000:3.0:1779690548.438658:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:3.0:1779690548.438668:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+56:108588:x1866137503728000:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:3.0:1779690548.438975:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108588:x1866137503728000:12345-192.168.203.5@tcp:35:cp.0 Request processed in 309us (530us total) trans 12884902272 rc 0/0 00000100:00100000:3.0:1779690548.438981:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:3.0:1779690548.673668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.673717:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.673747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.673772:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690548.673801:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728256 00000100:00100000:3.0:1779690548.673840:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728256 00000100:00100000:3.0:1779690548.673894:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728512 00000100:00100000:3.0:1779690548.673897:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728512 00000100:00100000:3.0:1779690548.673913:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728384 00000100:00100000:3.0:1779690548.673916:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728384 00000100:00100000:3.0:1779690548.673937:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2948 00000100:00100000:3.0:1779690548.673945:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503728256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690548.674020:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2391:x1866137503728256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.674027:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2948 00000100:00100000:3.0:1779690548.674046:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2949 00000100:00100000:3.0:1779690548.674052:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+8:2391:x1866137503728512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690548.674077:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+8:2391:x1866137503728512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.674095:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2949 00000100:00100000:3.0:1779690548.674109:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2950 00000100:00100000:3.0:1779690548.674115:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503728384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690548.674142:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503728384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.674148:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2950 00000100:00100000:3.0:1779690548.674167:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728128 00000100:00100000:3.0:1779690548.674170:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728128 00000100:00100000:3.0:1779690548.674195:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00100000:3.0:1779690548.674201:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503728128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690548.674223:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503728128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690548.674230:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00080000:3.0:1779690548.674269:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690548.674273:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1779690548.680889:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690549.193996:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690549.194006:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690549.194510:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 8 00000040:00080000:3.0:1779690549.194519:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690549.704973:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690549.716847:0:70903:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690549.716855:0:70903:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690549.717663:0:70903:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690549.717673:0:70903:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000001:00080000:1.0:1779690549.757571:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902271 is committed 00000001:00080000:1.0:1779690549.757601:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902272 is committed 00000001:00080000:1.0:1779690549.757607:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902270 is committed 00000020:00000080:2.0:1779690550.455907:0:70953:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffeb1209bf0 00000004:00000080:2.0:1779690550.455922:0:70953:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e3091cc2400 uarg=0000000000000000 00000004:00000080:2.0:1779690550.455960:0:70953:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e3091cc2400 00000040:00080000:2.0:1779690550.456283:0:70953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].11, 80 off9072 00000004:00000080:2.0:1779690550.456306:0:70953:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl11', mask 0x0 00000004:02000000:2.0:1779690550.456308:0:70953:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690550.542746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690550.542925:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728640 00000100:00100000:0.0:1779690550.542939:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728640 00000100:00100000:0.0:1779690550.543856:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 828 00000100:00100000:0.0:1779690550.543866:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:108628:x1866137503728640:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690550.543884:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690550.543902:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f7cb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee067 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.543958:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.543972:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.543983:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.543996:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544002:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544009:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544327:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544336:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544343:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690550.544377:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x22:0x0]: returning size 1516 00000004:00200000:0.0:1779690550.544381:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690550.544397:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544408:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544415:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544421:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544428:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544433:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690550.544437:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544444:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544455:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:0.0:1779690550.544457:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690550.544461:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544467:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913f7d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544487:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544492:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544498:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544502:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690550.544505:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544510:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544516:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690550.544519:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690550.544521:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544526:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f7d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544555:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913f7cb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee067 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544567:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee067 expref: 52 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690550.544584:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690550.544587:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690550.544589:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690550.544646:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+52:108628:x1866137503728640:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 782us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690550.544654:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 828 00000100:00080000:3.0:1779690550.547395:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690550.549239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690550.549308:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728768 00000100:00100000:3.0:1779690550.549317:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728768 00000100:00100000:3.0:1779690550.549374:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6452 00000100:00100000:3.0:1779690550.549384:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503728768:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690550.549400:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690550.549423:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f7e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee06e expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690550.549490:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492346624:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690550.549569:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30b1bf8cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1779690550.550062:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1779690550.557129:0:10273:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1779690550.557136:0:10273:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb mtime: 0 -> 1779690548 00002000:00010000:3.0:1779690550.557138:0:10273:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb atime: 0 -> 1779690548 00002000:00010000:3.0:1779690550.557140:0:10273:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb ctime: 0 -> 1779690548 00000100:00100000:3.0:1779690550.557163:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492346624:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690550.557196:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f7e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee06e expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690550.557217:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f7e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee06e expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690550.557242:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267200, rc 0) 00000100:00100000:3.0:1779690550.557292:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503728768:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 7909us (8069us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690550.557300:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6452 00000100:00100000:3.0:1779690550.561147:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690550.561483:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503728896 00000100:00100000:2.0:1779690550.561495:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503728896 00000100:00100000:2.0:1779690550.561548:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 829 00000100:00100000:2.0:1779690550.561558:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+52:108628:x1866137503728896:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690550.561577:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690550.561595:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee075 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.561672:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.561697:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.561708:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690550.563120:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8c:0x0]: returning size 7680 00000004:00200000:2.0:1779690550.563128:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690550.563244:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.563280:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee075 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.563297:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee075 expref: 53 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690550.563305:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:2.0:1779690550.563308:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690550.563311:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690550.563390:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:108628:x1866137503728896:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1833us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690550.563399:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 829 00000100:00100000:2.0:1779690550.567222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690550.567317:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729024 00000100:00100000:0.0:1779690550.567326:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729024 00000100:00100000:0.0:1779690550.567391:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6453 00000100:00100000:0.0:1779690550.567400:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503729024:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690550.567418:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690550.567435:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd1fc53/0xb4bb873a1913f7fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee07c expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690550.567730:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492346752:192.168.203.5@tcp:106: 00000100:00100000:0.0:1779690550.567874:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82ac0900 going to sleep for 11 seconds 00000100:00100000:3.0:1779690550.575718:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22279:1866137492346752:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690550.575756:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bd1fc53/0xb4bb873a1913f7fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee07c expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690550.575798:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd1fc53/0xb4bb873a1913f7fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee07c expref: 18 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690550.576614:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:3.0:1779690550.576686:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503729024:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 9285us (9473us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690550.576695:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6453 00000100:00100000:1.0:1779690550.590198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690550.590771:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729280 00000100:00100000:3.0:1779690550.590782:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729280 00000100:00100000:3.0:1779690550.590951:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 830 00000100:00100000:3.0:1779690550.590963:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:108628:x1866137503729280:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690550.594270:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].37, 136 off13224 00000100:00100000:3.0:1779690550.594462:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:108628:x1866137503729280:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 3496us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690550.594545:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 830 00010000:00010000:1.0:1779690550.728984:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690551.205086:0:71002:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690551.205097:0:71002:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690551.205165:0:71002:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 38 count 9 00000040:00080000:2.0:1779690551.205170:0:71002:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690551.241099:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690551.241104:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690551.241142:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 38 count 9 00000040:00080000:3.0:1779690551.241149:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690551.241391:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492346880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690551.241463:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690551.241655:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492347136:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690551.241667:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492347008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690551.241720:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690551.242244:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492346880 00000100:00100000:1.0:1779690551.242251:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492346880 00000100:00100000:3.0:1779690551.242256:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30b1bf8240 going to sleep for 11 seconds 00000100:00100000:1.0:1779690551.242309:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492347008 00000100:00100000:1.0:1779690551.242313:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492347008 00000100:00100000:1.0:1779690551.242333:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1779690551.242341:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492346880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690551.242369:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3827302400 avail 3825205248 00000100:00080000:2.0:1779690551.242388:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690551.242394:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690551.242420:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492346880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690551.242427:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1779690551.242446:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1779690551.242450:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492346880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690551.242457:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492347008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690551.242475:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690551.242501:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492347008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690551.242506:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1779690551.243765:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492347264:0@lo:400:kworker.0 00000100:00100000:3.0:1779690551.243769:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492347392:0@lo:400:kworker.0 00000100:00100000:1.0:1779690551.243839:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690551.243844:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690551.243882:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690551.243889:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492347648:0@lo:400:kworker.0 00000100:00100000:1.0:1779690551.243916:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690551.243969:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492347264 00000100:00100000:2.0:1779690551.243975:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492347264 00000100:00100000:2.0:1779690551.244114:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1779690551.244122:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.244165:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492347264:12345-0@lo:400:kworker.0 Request processed in 45us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690551.244172:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1779690551.244202:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492347392 00000100:00100000:2.0:1779690551.244205:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492347392 00000100:00100000:2.0:1779690551.244244:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492347648 00000100:00100000:2.0:1779690551.244246:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492347648 00000100:00100000:2.0:1779690551.244263:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1779690551.244269:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492347392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.244298:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492347392:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690551.244303:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1779690551.244314:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1779690551.244319:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492347648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.244343:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492347648:12345-0@lo:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690551.244348:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1779690551.246876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690551.247160:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729408 00000100:00100000:2.0:1779690551.247168:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729408 00000100:00100000:2.0:1779690551.247214:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 831 00000100:00100000:0.0:1779690551.247234:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492347008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690551.247235:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503729408:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690551.247271:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x22:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690551.247373:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503729408:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 140us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690551.247381:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 831 00000100:00080000:2.0:1779690551.247795:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690551.247849:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492347648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.247861:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492347264:0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.247889:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492347520:0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.247930:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690551.248122:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492347392:0@lo:400:kworker.0 00000100:00100000:3.0:1779690551.248153:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492347520 00000100:00100000:3.0:1779690551.248157:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492347520 00000100:00100000:3.0:1779690551.248516:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1779690551.248524:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492347520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690551.248576:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492347520:12345-0@lo:400:kworker.0 Request processed in 53us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690551.248583:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:2.0:1779690551.248614:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690551.248633:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492347520:0@lo:400:kworker.0 00000100:00100000:2.0:1779690551.249599:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492347136:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690551.251465:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690551.251543:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729664 00000100:00100000:2.0:1779690551.251550:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729664 00000100:00100000:2.0:1779690551.251622:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 832 00000100:00100000:2.0:1779690551.251631:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:108639:x1866137503729664:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690551.251649:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690551.251668:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f803 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee083 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690551.251758:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f80a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690551.251785:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f80a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690551.251797:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f80a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690551.251836:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x22:0x0]: returning size 1516 00010000:00010000:2.0:1779690551.251994:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f803 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee083 expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690551.252008:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f80a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee083 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690551.252016:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:2.0:1779690551.252019:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690551.252022:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c600, rc 0) 00000100:00100000:2.0:1779690551.252081:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:108639:x1866137503729664:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 451us (621us total) trans 12884902273 rc 0/0 00000100:00100000:2.0:1779690551.252088:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 832 00000100:00100000:0.0:1779690551.255335:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.257363:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729792 00000100:00100000:3.0:1779690551.257375:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729792 00000100:00100000:3.0:1779690551.257448:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18677 00000100:00100000:3.0:1779690551.257459:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+55:2390:x1866137503729792:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690551.257472:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690551.257494:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f80a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee083 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.257511:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690551.257515:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690551.257572:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+54:2390:x1866137503729792:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 115us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690551.257579:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18677 00000100:00100000:0.0:1779690551.261549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.262339:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503729920 00000100:00100000:3.0:1779690551.262349:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503729920 00000100:00100000:3.0:1779690551.262455:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6454 00000100:00100000:3.0:1779690551.262466:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2389:x1866137503729920:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690551.262507:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.262538:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.262546:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690551.262548:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690551.262552:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.262588:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.262601:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 8 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690551.262615:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492347776:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690551.262699:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30b1bf8b40 going to sleep for 11 seconds 00000100:00080000:0.0:1779690551.262829:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690551.267782:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492347776:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690551.267837:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690551.268869:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.271013:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730048 00000100:00100000:3.0:1779690551.271025:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730048 00002000:00100000:3.0:1779690551.271070:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1ee:0x0] (0->1515) req@ffff9e30b43f8a80 x1866137503730048/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:32/0 lens 2008/0 e 0 to 0 dl 1779690562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690551.271081:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30b43f8a80 with x1866137503730048 ext(0->1515) 00010000:00010000:3.0:1779690551.271089:0:17861:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 9 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.271103:0:17861:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 9 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690551.271116:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e30b43f8a80 00000100:00100000:3.0:1779690551.271151:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1779690551.271161:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503730048:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:3.0:1779690551.271619:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503730048:12345-192.168.203.5@tcp:4:cp.0 Request processed in 459us (2752us total) trans 4294968348 rc 0/0 00000100:00100000:3.0:1779690551.271626:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00002000:00100000:3.0:1779690551.271633:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1ee:0x0] (0->1515) req@ffff9e30b43f8a80 x1866137503730048/t4294968348(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:32/0 lens 2008/448 e 0 to 0 dl 1779690562 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690551.271641:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30b43f8a80 with x1866137503730048 ext(0->1515) 00010000:00010000:3.0:1779690551.271646:0:17861:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.271657:0:17861:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690551.271664:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e30b43f8a80 00000100:00100000:1.0:1779690551.274039:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690551.274319:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730176 00000100:00100000:0.0:1779690551.274331:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730176 00010000:00010000:0.0:1779690551.274366:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690551.274408:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3276 00000100:00100000:0.0:1779690551.274426:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503730176:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690551.274443:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690551.274464:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.274479:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.274502:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000716d8b3b/0xb4bb873a1913f7c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee060 expref: 11 pid: 22279 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.274517:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690551.274520:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690551.274524:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.274558:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.274610:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690551.274660:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503730176:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 244us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690551.274677:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3276 00010000:00010000:1.0:1779690551.275365:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275376:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275403:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275410:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275417:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275423:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690551.275427:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275446:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275458:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.275465:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b24876ea/0xb4bb873a1913f818 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690551.275526:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503729920:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 13062us (13995us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690551.275534:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6454 00000100:00100000:1.0:1779690551.285158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.285272:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730432 00000100:00100000:3.0:1779690551.285282:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730432 00000100:00100000:3.0:1779690551.285334:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 833 00000100:00100000:3.0:1779690551.285344:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503730432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690551.285452:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503730432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 109us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690551.285459:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 833 00000100:00100000:0.0:1779690551.289194:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.289270:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730560 00000100:00100000:3.0:1779690551.289279:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730560 00000100:00100000:3.0:1779690551.289332:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6455 00000100:00100000:3.0:1779690551.289342:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503730560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690551.289359:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690551.289378:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee08a expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690551.289404:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ee:0x0] initial LVB size: 1516, mtime: 0x6a13ec34, atime: 0x0, ctime: 0x6a13ec34, blocks: 0x1 00010000:00010000:3.0:1779690551.289420:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690551.289423:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690551.289430:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 10 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.289448:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 10 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.289462:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267c00, rc 0) 00000100:00100000:3.0:1779690551.289514:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503730560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 174us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690551.289521:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6455 00000100:00100000:2.0:1779690551.294754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690551.295185:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730816 00000100:00100000:0.0:1779690551.295196:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730816 00000100:00100000:0.0:1779690551.295788:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 834 00000100:00100000:0.0:1779690551.295799:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503730816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690551.296036:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503730816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 238us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690551.296044:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 834 00000100:00100000:0.0:1779690551.305167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.305255:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503730944 00000100:00100000:3.0:1779690551.305264:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503730944 00002000:00100000:3.0:1779690551.305310:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1ee:0x0] (0->4095) req@ffff9e30b43fb480 x1866137503730944/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:32/0 lens 488/0 e 0 to 0 dl 1779690562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690551.305320:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30b43fb480 with x1866137503730944 ext(0->4095) 00002000:00010000:3.0:1779690551.305331:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30b43fb480 00000100:00100000:3.0:1779690551.306952:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2081 00000100:00100000:3.0:1779690551.306965:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503730944:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1779690551.307163:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503730944:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 201us (2004us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1779690551.307171:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2081 00002000:00100000:3.0:1779690551.307179:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1ee:0x0] (0->4095) req@ffff9e30b43fb480 x1866137503730944/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:32/0 lens 488/4536 e 0 to 0 dl 1779690562 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690551.307187:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30b43fb480 with x1866137503730944 ext(0->4095) 00002000:00010000:3.0:1779690551.307192:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30b43fb480 00000100:00100000:1.0:1779690551.313471:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690551.313504:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731072 00000100:00100000:1.0:1779690551.313512:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731072 00000100:00100000:1.0:1779690551.313560:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 835 00000100:00100000:1.0:1779690551.313570:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:108639:x1866137503731072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690551.313589:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690551.313607:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f826 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee091 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313639:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313653:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313671:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313756:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f826 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313770:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690551.313778:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:1.0:1779690551.313781:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690551.313784:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690551.314157:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:108639:x1866137503731072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 587us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690551.314164:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 835 00000100:00100000:1.0:1779690551.323831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690551.324045:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731200 00000100:00100000:0.0:1779690551.324055:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731200 00000100:00100000:0.0:1779690551.324110:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 836 00000100:00100000:0.0:1779690551.324121:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:108639:x1866137503731200:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690551.324149:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x22:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690551.324252:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:108639:x1866137503731200:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 132us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690551.324259:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 836 00000100:00100000:1.0:1779690551.329338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.329490:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731328 00000100:00100000:3.0:1779690551.329500:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731328 00000100:00100000:3.0:1779690551.329556:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6456 00000100:00100000:3.0:1779690551.329566:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503731328:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690551.329607:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329623:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690551.329625:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690551.329630:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329644:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329672:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329688:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329697:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329709:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690551.329713:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329721:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329736:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.329743:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f834 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690551.329846:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503731328:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 282us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690551.329854:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6456 00000100:00100000:1.0:1779690551.334639:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.334701:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731584 00000100:00100000:3.0:1779690551.334711:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731584 00000100:00100000:3.0:1779690551.334830:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 837 00000100:00100000:3.0:1779690551.334847:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:108639:x1866137503731584:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690551.334926:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.334943:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.334953:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.334986:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.334999:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 55 pid: 57561 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690551.335012:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492347904:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690551.335094:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30b1bf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690551.338675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690551.338841:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731712 00000100:00100000:0.0:1779690551.338849:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731712 00010000:00010000:0.0:1779690551.338884:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 56 pid: 57561 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690551.338923:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3277 00000100:00100000:0.0:1779690551.338932:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+56:2392:x1866137503731712:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690551.338946:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690551.338952:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 56 pid: 57561 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.338965:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 56 pid: 57561 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.338988:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690551.338994:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.339003:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.339010:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690551.339027:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690551.339074:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+56:2392:x1866137503731712:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690551.339081:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3277 00010000:00010000:3.0:1779690551.339425:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f82d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee091 expref: 55 pid: 57561 timeout: 3378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690551.339442:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492347904:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690551.339460:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.339468:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.339487:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690551.340072:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902274 00010000:00010000:3.0:1779690551.340101:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340110:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340116:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340121:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690551.340125:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340132:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340143:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690551.340146:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690551.340150:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690551.340156:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f83b lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690551.340275:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:108639:x1866137503731584:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 5429us (5642us total) trans 12884902275 rc 0/0 00000100:00100000:3.0:1779690551.340293:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 837 00000020:00080000:3.0:1779690551.340297:0:64445:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1779690551.340669:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690551.340679:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690551.341249:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:0.0:1779690551.341257:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690551.342423:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690551.342475:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503731968 00000100:00100000:3.0:1779690551.342482:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503731968 00000100:00100000:3.0:1779690551.342523:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:3.0:1779690551.342531:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+56:108639:x1866137503731968:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690551.342714:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108639:x1866137503731968:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 183us (293us total) trans 12884902276 rc 0/0 00000100:00100000:3.0:1779690551.342721:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00010000:00010000:2.0:1779690551.753200:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690552.777084:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690552.852304:0:71053:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690552.852312:0:71053:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690552.852378:0:71053:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 38 count 9 00000040:00080000:2.0:1779690552.852385:0:71053:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690553.109143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.109244:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732096 00000100:00100000:3.0:1779690553.109255:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732096 00000100:00100000:3.0:1779690553.109337:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6457 00000100:00100000:3.0:1779690553.109348:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503732096:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690553.109365:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690553.109382:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee098 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.109409:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690553.109412:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690553.109421:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.109439:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.109452:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267200, rc 0) 00000100:00100000:3.0:1779690553.109523:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+18:2389:x1866137503732096:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 177us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.109530:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6457 00000100:00080000:0.0:1779690553.109606:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690553.114950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690553.115786:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732352 00000100:00100000:2.0:1779690553.115796:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732352 00000100:00100000:3.0:1779690553.119055:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 838 00000100:00100000:3.0:1779690553.119070:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:108674:x1866137503732352:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690553.120460:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].38, 136 off13360 00000100:00100000:3.0:1779690553.120605:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:108674:x1866137503732352:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1538us (5659us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.120615:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 838 00000100:00080000:0.0:1779690553.123344:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1779690553.329583:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968348 is committed 00000040:00080000:0.0:1779690553.425026:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690553.425032:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690553.425679:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 39 count 9 00000040:00080000:0.0:1779690553.425687:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690553.425800:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492348032:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690553.426778:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82ac0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1779690553.440164:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492348032:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1779690553.784783:0:71106:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690553.784795:0:71106:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690553.785001:0:71106:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 39 count 9 00000040:00080000:2.0:1779690553.785007:0:71106:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690553.796169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796351:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796372:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.796400:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732736 00000100:00100000:3.0:1779690553.796409:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732736 00000100:00100000:3.0:1779690553.796457:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503733248 00000100:00100000:3.0:1779690553.796461:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503733248 00000100:00100000:3.0:1779690553.796480:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732864 00000100:00100000:3.0:1779690553.796482:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732864 00000100:00100000:3.0:1779690553.796500:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503733120 00000100:00100000:3.0:1779690553.796502:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503733120 00000100:00100000:3.0:1779690553.796523:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2951 00000100:00100000:3.0:1779690553.796533:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503732736:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690553.796613:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503732736:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.796621:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2951 00000100:00100000:3.0:1779690553.796639:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2952 00000100:00100000:3.0:1779690553.796646:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503733248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690553.796672:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503733248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.796677:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2952 00000100:00100000:3.0:1779690553.796690:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2953 00000100:00100000:3.0:1779690553.796696:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503732864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690553.796720:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503732864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.796725:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2953 00000100:00100000:3.0:1779690553.796737:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2954 00000100:00100000:3.0:1779690553.796743:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503733120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690553.796764:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503733120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690553.796769:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2954 00000100:00100000:1.0:1779690553.796926:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732992 00000100:00100000:1.0:1779690553.796931:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732992 00000100:00100000:1.0:1779690553.797030:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732608 00000100:00100000:1.0:1779690553.797034:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732608 00000100:00100000:1.0:1779690553.797123:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 262 00000100:00100000:1.0:1779690553.797133:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:2392:x1866137503732992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690553.797172:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:2392:x1866137503732992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690553.797179:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 262 00000100:00100000:1.0:1779690553.797205:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 263 00000100:00100000:1.0:1779690553.797296:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503732608:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690553.797328:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503732608:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690553.797335:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 263 00000100:00100000:0.0:1779690553.797385:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503732480 00000100:00100000:0.0:1779690553.797390:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503732480 00000100:00100000:0.0:1779690553.797425:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:0.0:1779690553.797434:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503732480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690553.797530:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503732480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690553.797537:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00080000:0.0:1779690553.797569:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690553.797574:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690553.797576:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1779690553.805841:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690553.830061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.830146:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503733504 00000100:00100000:3.0:1779690553.830156:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503733504 00000100:00100000:3.0:1779690553.830230:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 839 00000100:00100000:3.0:1779690553.830241:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:108685:x1866137503733504:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:3.0:1779690553.830291:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1779690553.830326:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913f7e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee067 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830345:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690553.830356:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f7f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee075 expref: 52 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830365:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:3.0:1779690553.830368:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690553.830391:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830404:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830414:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830430:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830437:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.830444:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.834597:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.834621:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.834637:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.834675:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.834692:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 56 pid: 57560 timeout: 3381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690553.834707:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492348160:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690553.834826:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209e40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690553.838399:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aef83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492348160:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690553.838428:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690553.843651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690553.843872:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503733632 00000100:00100000:0.0:1779690553.843888:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503733632 00010000:00010000:0.0:1779690553.843926:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 57 pid: 57560 timeout: 3381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690553.843965:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3278 00000100:00100000:0.0:1779690553.843975:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503733632:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690553.843987:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690553.843993:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 57 pid: 57560 timeout: 3381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844006:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 57 pid: 57560 timeout: 3381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844028:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913f7af lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee052 expref: 57 pid: 57560 timeout: 3381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844039:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:0.0:1779690553.844044:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844053:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844061:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690553.844085:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690553.844093:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.844101:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690553.844133:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+56:2391:x1866137503733632:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 159us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690553.844148:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3278 00000040:00080000:1.0:1779690553.845925:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].10, 64 off8880 00000004:00080000:1.0:1779690553.845938:0:57561:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3281420131979ns, next at 3282420129357ns, rc = 0 00010000:00010000:1.0:1779690553.846050:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846065:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846074:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846082:0:57561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846088:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846094:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846127:0:57561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1779690553.846148:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846155:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846160:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846166:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690553.846170:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846178:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846188:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:1.0:1779690553.846201:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1779690553.846207:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846213:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913f857 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846230:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846235:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846252:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846257:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690553.846260:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846267:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846276:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x0 (ffff9e308a642500) 00010000:00010000:1.0:1779690553.846279:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690553.846281:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.846287:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f849 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690553.846298:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f5a0521b reply state 00000000b345cb75 transno 12884902277 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690553.846307:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690553.846385:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:108685:x1866137503733504:12345-192.168.203.5@tcp:36:rm.0 Request processed in 16144us (16333us total) trans 12884902277 rc 0/0 00000100:00100000:1.0:1779690553.846393:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 839 00010000:00010000:3.0:1779690553.848202:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690553.848212:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.848221:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690553.848225:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.848233:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.848248:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690553.848257:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690553.848262:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.848269:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f85e lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.848289:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690553.848291:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690553.848292:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690553.850001:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850015:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850021:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850026:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690553.850030:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850037:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850052:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8c:0x0].0x402924b4 (ffff9e2f905adb00) 00010000:00010000:3.0:1779690553.850055:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690553.850060:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690553.850065:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f850 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8c:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690553.938313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690553.938559:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503733760 00000100:00100000:1.0:1779690553.938569:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503733760 00000100:00100000:1.0:1779690553.938628:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 840 00000100:00100000:1.0:1779690553.938638:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:108692:x1866137503733760:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690553.938680:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x22:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1779690553.938750:0:57559:0:(mdt_handler.c:8003:mdt_fid2path()) nonlocal object [0x200000bd3:0x22:0x0]: rc = -2 00000100:00100000:1.0:1779690553.938868:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:108692:x1866137503733760:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 231us (562us total) trans 0 rc -2/-2 00000100:00100000:1.0:1779690553.938876:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 840 00000100:00100000:0.0:1779690553.951653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690553.951749:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734016 00000100:00100000:3.0:1779690553.951758:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734016 00000100:00100000:2.0:1779690553.952229:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 841 00000100:00100000:2.0:1779690553.952244:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:108692:x1866137503734016:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690553.952265:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690553.952284:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f865 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee09f expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690553.952462:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f865 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee09f expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690553.952475:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690553.952479:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690553.952483:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f865 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee09f expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690553.952496:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690553.952560:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:108692:x1866137503734016:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 321us (916us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690553.952568:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 841 00000100:00100000:0.0:1779690553.962211:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690553.963841:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734272 00000100:00100000:1.0:1779690553.963854:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734272 00000100:00100000:1.0:1779690553.963922:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 842 00000100:00100000:1.0:1779690553.963933:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+56:108692:x1866137503734272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690553.964072:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964089:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964100:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964111:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964117:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964124:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964129:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690553.964132:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964152:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964164:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x22:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:1.0:1779690553.964166:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690553.964171:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690553.964177:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f86c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690553.964920:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:108692:x1866137503734272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 986us (2723us total) trans 12884902278 rc 0/0 00000100:00100000:1.0:1779690553.964929:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 842 00000040:00080000:3.0:1779690553.965059:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690553.965065:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690553.965665:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:3.0:1779690553.965674:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690554.490420:0:71157:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690554.490429:0:71157:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690554.490500:0:71157:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 39 count 9 00000040:00080000:3.0:1779690554.490505:0:71157:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690554.570939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690554.571007:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734400 00000100:00100000:2.0:1779690554.571016:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734400 00000100:00100000:2.0:1779690554.571070:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 843 00000100:00100000:2.0:1779690554.571081:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734400:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690554.571251:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734400:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 172us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690554.571266:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 843 00000100:00100000:0.0:1779690554.573118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690554.573195:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734528 00000100:00100000:3.0:1779690554.573203:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734528 00000100:00100000:3.0:1779690554.573249:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 844 00000100:00100000:3.0:1779690554.573258:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734528:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1779690554.573391:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690554.573443:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734528:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 186us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690554.573450:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 844 00000100:00100000:0.0:1779690554.576000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690554.576076:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734656 00000100:00100000:3.0:1779690554.576085:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734656 00000100:00100000:3.0:1779690554.576135:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 845 00000100:00100000:3.0:1779690554.576144:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734656:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690554.576332:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690554.576411:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734656:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 268us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690554.576418:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 845 00000100:00100000:3.0:1779690554.578338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690554.578739:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734784 00000100:00100000:2.0:1779690554.578748:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734784 00000100:00100000:2.0:1779690554.578794:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 846 00000100:00100000:2.0:1779690554.578822:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734784:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690554.578950:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690554.579020:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734784:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 218us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690554.579027:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 846 00000100:00100000:3.0:1779690554.580901:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690554.580990:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503734912 00000100:00100000:2.0:1779690554.580998:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503734912 00000100:00100000:2.0:1779690554.581038:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 847 00000100:00100000:2.0:1779690554.581047:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734912:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690554.581141:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503734912:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690554.581149:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 847 00000100:00100000:0.0:1779690554.582286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690554.582343:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735040 00000100:00100000:1.0:1779690554.582349:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735040 00000100:00100000:1.0:1779690554.582390:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 848 00000100:00100000:1.0:1779690554.582399:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735040:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690554.582559:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735040:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 161us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690554.582567:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 848 00000100:00100000:3.0:1779690554.584924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690554.584990:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735168 00000100:00100000:2.0:1779690554.584997:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735168 00000100:00100000:2.0:1779690554.585043:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 849 00000100:00100000:2.0:1779690554.585051:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735168:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690554.585224:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735168:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690554.585231:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 849 00000100:00100000:3.0:1779690554.587090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690554.587169:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735296 00000100:00100000:1.0:1779690554.587177:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735296 00000100:00100000:1.0:1779690554.587721:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 850 00000100:00100000:1.0:1779690554.587732:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735296:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690554.588023:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735296:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 293us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690554.588037:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 850 00000100:00100000:1.0:1779690554.592864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690554.592949:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735424 00000100:00100000:0.0:1779690554.592959:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735424 00000100:00100000:0.0:1779690554.593010:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 851 00000100:00100000:0.0:1779690554.593019:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735424:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690554.593199:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:108707:x1866137503735424:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 168us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690554.593208:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 851 00010000:00010000:1.0:1779690554.827055:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690554.875200:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902277 is committed 00000004:00080000:3.0:1779690554.875210:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:0.0:1779690554.875425:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690554.875443:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492348288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1779690554.875508:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1779690554.876301:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902278 is committed 00000100:00100000:1.0:1779690554.876418:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492348288 00000100:00100000:1.0:1779690554.876426:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492348288 00000100:00100000:1.0:1779690554.876488:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6458 00000100:00100000:1.0:1779690554.876497:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492348288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1779690554.876524:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:494 count 1 00010000:00010000:1.0:1779690554.876548:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690554.876571:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 7 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690554.876581:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 17 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690554.876589:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690554.876591:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690554.876594:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690554.876620:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 17 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690554.876711:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1779690554.876750:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 17 pid: 10273 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690554.876770:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492348416:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690554.876868:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 7 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690554.876878:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 7 pid: 49882 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690554.876887:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492348544:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690554.876912:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690554.884998:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690554.885121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690554.885205:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492348416:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690554.885219:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492348544:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690554.885245:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690554.889936:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735552 00000100:00100000:3.0:1779690554.889950:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735552 00010000:00010000:2.0:1779690554.890063:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690554.890100:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735680 00000100:00100000:2.0:1779690554.890103:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735680 00010000:00010000:2.0:1779690554.890119:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 8 pid: 49882 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690554.890130:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3279 00000100:00100000:3.0:1779690554.890144:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503735552:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1779690554.890153:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3280 00010000:00010000:3.0:1779690554.890161:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1779690554.890162:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503735680:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690554.890170:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890172:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690554.890191:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 8 pid: 49882 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890209:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890497:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 8 pid: 49882 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890520:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913f81f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee08a expref: 8 pid: 49882 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890536:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690554.890586:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a0dc2a/0xb4bb873a1913f842 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee098 expref: 18 pid: 10273 timeout: 3382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690554.890599:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503735680:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 436us (5476us total) trans 0 rc 0/0 00010000:00010000:3.0:1779690554.890600:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690554.890603:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1779690554.890610:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3280 00010000:00010000:3.0:1779690554.890611:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890624:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890714:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690554.890748:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503735552:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 609us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690554.890756:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3279 00010000:00010000:2.0:1779690554.890789:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890892:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890903:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890912:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690554.890932:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1779690554.890950:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690554.890956:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890963:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690554.890967:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890975:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890986:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.890992:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002062469d/0xb4bb873a1913f873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690554.891010:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690554.891011:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690554.891013:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690554.892152:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492348288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15654us (16642us total) trans 4294968349 rc 0/0 00000100:00100000:2.0:1779690554.892162:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6458 00000004:00080000:3.0:1779690554.892988:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f82fa1c00/2, rc 0, transno 4294968349 00000100:00100000:3.0:1779690554.892997:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492348288:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1779690555.849833:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690556.360921:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690556.360941:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492348672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690556.361006:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690556.361213:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492348672 00000100:00100000:1.0:1779690556.361222:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492348672 00000100:00100000:1.0:1779690556.361293:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1779690556.361302:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492348672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690556.361335:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690556.361381:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492348672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690556.361388:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1779690556.361440:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492348672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690556.361527:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690556.361536:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492348800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690556.361567:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1779690556.361735:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690556.361873:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492348928:0@lo:400:kworker.0 00000100:00100000:3.0:1779690556.361908:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690556.362047:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492348928 00000100:00100000:1.0:1779690556.362051:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492348928 00000100:00100000:1.0:1779690556.362079:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1779690556.362087:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690556.362210:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492348800 00000100:00100000:0.0:1779690556.362214:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492348800 00000100:00100000:0.0:1779690556.362248:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1779690556.362263:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492348800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690556.362295:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742326272 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690556.362326:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492348800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690556.362332:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1779690556.362350:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492349056:0@lo:400:kworker.0 00000100:00100000:0.0:1779690556.362375:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690556.362404:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349056 00000100:00100000:0.0:1779690556.362408:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349056 00000100:00100000:0.0:1779690556.362438:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1779690556.362444:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492349056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690556.362477:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492349056:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690556.362484:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1779690556.362511:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492349056:0@lo:400:kworker.0 00000100:00080000:0.0:1779690556.362527:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690556.362530:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690556.362698:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492348928:12345-0@lo:400:kworker.0 Request processed in 612us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690556.362706:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1779690556.362738:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492349184:0@lo:400:kworker.0 00000100:00100000:1.0:1779690556.362765:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690556.362829:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492348800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690556.362843:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690556.362850:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492349312:0@lo:400:kworker.0 00000100:00100000:1.0:1779690556.362875:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690556.362904:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349184 00000100:00100000:1.0:1779690556.362908:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349184 00000100:00100000:1.0:1779690556.362935:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349312 00000100:00100000:1.0:1779690556.362938:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349312 00000100:00100000:1.0:1779690556.362954:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1779690556.362961:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492349184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690556.362995:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492349184:12345-0@lo:400:kworker.0 Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690556.363002:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1779690556.363020:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1779690556.363026:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492349312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690556.363053:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492349312:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690556.363059:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1779690556.363074:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690556.363094:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492349312:0@lo:400:kworker.0 00000100:00100000:1.0:1779690556.363103:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492349184:0@lo:400:kworker.0 00000100:00100000:3.0:1779690556.363398:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492348928:0@lo:400:kworker.0 00010000:00010000:1.0:1779690556.873325:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690557.897927:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690558.412456:0:71358:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690558.412462:0:71358:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690558.412498:0:71358:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 12 count 2 00000040:00080000:1.0:1779690558.412505:0:71358:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000001:00080000:3.0:1779690558.457290:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968349 is committed 00000100:00100000:0.0:1779690558.465717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690558.465756:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735808 00000100:00100000:0.0:1779690558.465765:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735808 00000100:00100000:0.0:1779690558.465849:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 852 00000100:00100000:0.0:1779690558.465860:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:109151:x1866137503735808:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690558.465906:0:57559:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b3958a30 uarg=0000000000000000 00000004:00000080:0.0:1779690558.465942:0:57559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b3958a30 00000004:00000080:0.0:1779690558.465948:0:57559:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=11, endrec=0 00000040:00080000:0.0:1779690558.466030:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690558.466042:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690558.466084:0:57559:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl11 endrec = 53 00000040:00080000:0.0:1779690558.466206:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 12 count 2 00000040:00080000:0.0:1779690558.466213:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690558.466219:0:57559:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl11 entries up to 18446744073709551615 00000040:00080000:0.0:1779690558.466254:0:57559:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690558.466256:0:57559:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000100:00080000:1.0:1779690558.466861:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1779690558.467117:0:57559:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 53 count 1 00000040:00080000:0.0:1779690558.467125:0:57559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690558.467347:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+52:109151:x1866137503735808:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 1485us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690558.467358:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 852 00000100:00100000:1.0:1779690558.914312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690558.914362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690558.914394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690558.914421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690558.914436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690558.914458:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736448 00000100:00100000:1.0:1779690558.914458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690558.914469:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736448 00000100:00100000:1.0:1779690558.914480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690558.914503:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736064 00000100:00100000:1.0:1779690558.914507:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736064 00000100:00100000:2.0:1779690558.914537:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:1.0:1779690558.914546:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:1.0:1779690558.914557:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2390:x1866137503736064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690558.914563:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+51:2390:x1866137503736448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690558.914640:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+51:2390:x1866137503736448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690558.914649:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:0.0:1779690558.914665:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503735936 00000100:00100000:0.0:1779690558.914671:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503735936 00000100:00100000:0.0:1779690558.914720:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:0.0:1779690558.914728:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503735936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690558.914841:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736192 00000100:00100000:3.0:1779690558.914846:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736192 00000100:00100000:3.0:1779690558.914884:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736704 00000100:00100000:3.0:1779690558.914887:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736704 00000100:00100000:3.0:1779690558.914908:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736320 00000100:00100000:3.0:1779690558.914911:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736320 00000100:00100000:3.0:1779690558.914929:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736576 00000100:00100000:3.0:1779690558.914932:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736576 00000100:00100000:3.0:1779690558.914951:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2955 00000100:00100000:3.0:1779690558.914957:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503736192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690558.915080:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2956 00000100:00100000:2.0:1779690558.915088:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503736704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690558.915213:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2390:x1866137503736064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 659us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690558.915238:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:1.0:1779690558.915264:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2957 00000100:00100000:1.0:1779690558.915272:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503736320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690558.915299:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503736320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690558.915305:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2957 00000100:00100000:1.0:1779690558.915334:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2958 00000100:00100000:1.0:1779690558.915341:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503736576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690558.915367:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503736576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690558.915373:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2958 00000100:00080000:1.0:1779690558.915389:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690558.915393:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690558.915395:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690558.915827:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503735936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1099us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690558.915835:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:3.0:1779690558.915970:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503736192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1011us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690558.915977:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2955 00000100:00100000:2.0:1779690558.916397:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503736704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1309us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690558.916416:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2956 00010000:00010000:3.0:1779690558.921412:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1779690559.029118:0:71407:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fffc55c6720 00000004:00000080:1.0:1779690559.029133:0:71407:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e2f83185000 uarg=0000000000000000 00000004:00000080:1.0:1779690559.029242:0:71407:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e2f83185000 00000004:00000080:1.0:1779690559.029249:0:71407:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=11, endrec=0 00000040:00080000:1.0:1779690559.029345:0:71407:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.029349:0:71407:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690559.029380:0:71407:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl11 endrec = 53 00000040:00080000:1.0:1779690559.029444:0:71407:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 12 count 2 00000040:00080000:1.0:1779690559.029451:0:71407:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690559.029481:0:71407:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl11 entries up to 18446744073709551615 00000040:00080000:1.0:1779690559.029526:0:71407:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.029535:0:71407:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690559.030269:0:71407:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690559.030277:0:71407:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:1.0:1779690559.030303:0:71407:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=11 00000040:00080000:1.0:1779690559.030355:0:71407:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.030358:0:71407:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690559.030583:0:71407:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 11 count 1 00000040:00080000:1.0:1779690559.030590:0:71407:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690559.030608:0:71407:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1779690559.030610:0:71407:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1779690559.038650:0:71407:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl11 record=18446744073709551615 00000040:00080000:1.0:1779690559.038911:0:71407:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.038915:0:71407:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690559.039743:0:71407:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690559.039870:0:71407:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:1.0:1779690559.039959:0:71407:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.039963:0:71407:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690559.041377:0:71407:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690559.041389:0:71407:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:1.0:1779690559.618965:0:71455:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690559.618973:0:71455:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690559.619517:0:71455:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690559.619527:0:71455:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1779690559.699214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690559.699287:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503736832 00000100:00100000:0.0:1779690559.699296:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503736832 00000100:00100000:0.0:1779690559.699356:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 853 00000100:00100000:0.0:1779690559.699366:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:108584:x1866137503736832:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1779690559.699469:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:108584:x1866137503736832:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690559.699477:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 853 00000100:00100000:1.0:1779690559.701219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690559.701289:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737088 00000100:00100000:3.0:1779690559.701297:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737088 00000100:00100000:3.0:1779690559.701345:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:3.0:1779690559.701354:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+52:108584:x1866137503737088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690559.701840:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+53:108584:x1866137503737088:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 484us (624us total) trans 12884902279 rc 0/0 00000100:00100000:3.0:1779690559.701857:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00010000:00010000:1.0:1779690559.945071:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690559.987230:0:71174:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902279 is committed 00000001:02000400:1.0:1779690560.839403:0:71505:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 225: Changelog for remove canceled ==== 02:29:19 (1779690559) 00010000:00010000:1.0:1779690560.970130:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690561.481234:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492349440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690561.481320:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690561.481505:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349440 00000100:00100000:0.0:1779690561.481524:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349440 00000100:00100000:0.0:1779690561.481576:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1779690561.481584:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492349440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690561.481618:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:1.0:1779690561.481716:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492349696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690561.481749:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1779690561.481783:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690561.481793:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349696 00000100:00100000:1.0:1779690561.481797:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349696 00000100:00100000:1.0:1779690561.481845:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1779690561.481850:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492349696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690561.481869:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742326272 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690561.481913:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492349696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690561.481920:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00080000:1.0:1779690561.481941:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690561.481962:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968349 gen 2 00000004:00080000:1.0:1779690561.481976:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f82fa1c00, transno 4294968349 00000100:00100000:1.0:1779690561.481992:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492349696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690561.482740:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492349568:0@lo:400:kworker.0 00000100:00100000:3.0:1779690561.482787:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690561.482799:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492349824:0@lo:400:kworker.0 00000100:00100000:3.0:1779690561.482844:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492350080:0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.482861:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690561.482881:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690561.482908:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690561.482917:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492349952:0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.482918:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349568 00000100:00100000:1.0:1779690561.482924:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349568 00000100:00100000:3.0:1779690561.482952:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690561.482960:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1779690561.483058:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492349568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.483101:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492349568:12345-0@lo:400:kworker.0 Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690561.483108:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1779690561.483145:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349824 00000100:00100000:1.0:1779690561.483148:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349824 00000100:00100000:1.0:1779690561.483178:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492350080 00000100:00100000:1.0:1779690561.483180:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492350080 00000100:00100000:1.0:1779690561.483204:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492349952 00000100:00100000:1.0:1779690561.483206:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492349952 00000100:00100000:1.0:1779690561.483218:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1779690561.483224:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.483268:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492349824:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690561.483274:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1779690561.483285:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1779690561.483358:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.483386:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492350080:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690561.483392:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1779690561.483403:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1779690561.483408:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492349952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690561.483430:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492349952:12345-0@lo:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690561.483435:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1779690561.483457:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690561.483482:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492349824:0@lo:400:kworker.0 00000100:00100000:3.0:1779690561.483609:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492349952:0@lo:400:kworker.0 00000100:00100000:3.0:1779690561.483620:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492349568:0@lo:400:kworker.0 00000100:00100000:3.0:1779690561.483634:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492350080:0@lo:400:kworker.0 00000100:00100000:0.0:1779690561.483640:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492349440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2054us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690561.483649:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1779690561.483716:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492349440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1779690561.994050:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690563.018423:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690563.209692:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690563.209702:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690563.209744:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 39 count 9 00000040:00080000:3.0:1779690563.209752:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690564.032340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690564.032410:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690564.032441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690564.032468:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690564.032487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690564.032507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690564.034276:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737216 00000100:00100000:1.0:1779690564.034289:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737216 00000100:00100000:1.0:1779690564.034340:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 197 00000100:00100000:1.0:1779690564.034350:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503737216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690564.034419:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503737216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690564.034427:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 197 00000100:00100000:1.0:1779690564.034466:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737600 00000100:00100000:1.0:1779690564.034470:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737600 00000100:00100000:1.0:1779690564.034501:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737856 00000100:00100000:1.0:1779690564.034504:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737856 00000100:00100000:1.0:1779690564.034520:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737472 00000100:00100000:1.0:1779690564.034522:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737472 00000100:00100000:1.0:1779690564.034540:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2959 00000100:00100000:1.0:1779690564.034546:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503737600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690564.034576:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503737600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690564.034582:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2959 00000100:00100000:1.0:1779690564.034593:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2960 00000100:00100000:1.0:1779690564.034599:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503737856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690564.034620:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503737856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690564.034625:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2960 00000100:00100000:1.0:1779690564.034635:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2961 00000100:00100000:1.0:1779690564.034640:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503737472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690564.034659:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503737472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690564.034664:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2961 00000100:00080000:1.0:1779690564.034789:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690564.034793:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690564.035126:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690564.035280:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737344 00000100:00100000:2.0:1779690564.035285:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737344 00000100:00100000:2.0:1779690564.035328:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737728 00000100:00100000:2.0:1779690564.035332:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737728 00000100:00100000:2.0:1779690564.035354:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:2.0:1779690564.035361:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2390:x1866137503737344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690564.035404:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+52:2390:x1866137503737344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690564.035411:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:2.0:1779690564.035424:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:2.0:1779690564.035430:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:2390:x1866137503737728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690564.035453:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:2390:x1866137503737728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690564.035459:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00080000:0.0:1779690564.036175:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690564.036365:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503737984 00000100:00100000:3.0:1779690564.036370:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503737984 00000100:00100000:3.0:1779690564.036418:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2962 00000100:00100000:3.0:1779690564.036426:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503737984:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690564.036460:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503737984:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690564.036467:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2962 00000100:00080000:0.0:1779690564.036519:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1779690564.042661:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690565.066500:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1779690565.186090:0:71702:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 02:29:24 (1779690564) 00000100:00100000:1.0:1779690565.373309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.373417:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503738240 00000100:00100000:2.0:1779690565.373427:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503738240 00000100:00100000:2.0:1779690565.373475:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 854 00000100:00100000:2.0:1779690565.373484:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+52:109919:x1866137503738240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690565.373504:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.373536:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f87a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0a6 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373607:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373621:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373632:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373645:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373651:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.373657:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374121:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f88f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374130:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f88f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374137:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f88f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690565.374146:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1779690565.374320:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374337:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374344:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374350:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.374354:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374361:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374371:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:2.0:1779690565.374374:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.374378:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374384:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374395:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374402:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374407:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374411:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.374418:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374424:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374431:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f826ec600) 00010000:00010000:2.0:1779690565.374433:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.374436:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374441:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f888 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374757:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f87a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0a6 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374772:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f88f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0a6 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.374779:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690565.374781:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.374783:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690565.374878:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:109919:x1866137503738240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1394us (1577us total) trans 12884902280 rc 0/0 00000100:00100000:2.0:1779690565.374886:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 854 00000100:00100000:1.0:1779690565.383905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.384011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690565.384127:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503738368 00000100:00100000:0.0:1779690565.384136:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503738368 00000100:00100000:0.0:1779690565.384189:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18678 00000100:00100000:0.0:1779690565.384198:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503738368:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690565.384212:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1779690565.384214:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503738496 00000100:00100000:2.0:1779690565.384220:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503738496 00010000:00010000:0.0:1779690565.384235:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f88f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0a6 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.384253:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690565.384258:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690565.384259:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 855 00000100:00100000:2.0:1779690565.384269:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:109919:x1866137503738496:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690565.387484:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503738368:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3276us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690565.387497:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18678 00000100:00100000:3.0:1779690565.387508:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:109919:x1866137503738496:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 3238us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.387520:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 855 00000100:00100000:0.0:1779690565.394667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.394878:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503738624 00000100:00100000:1.0:1779690565.394888:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503738624 00000100:00100000:1.0:1779690565.394934:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 856 00000100:00100000:1.0:1779690565.394944:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:109920:x1866137503738624:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690565.394964:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.394985:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f89d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0ad expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395049:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395064:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395085:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395101:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395108:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395114:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395475:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395483:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395496:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395503:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.395507:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395515:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395527:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:1.0:1779690565.395530:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.395535:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395541:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395665:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395671:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395677:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395741:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.395744:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395759:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395768:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.395770:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.395773:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.395779:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.397491:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f89d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0ad expref: 52 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.397508:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:1.0:1779690565.397511:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.397515:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913f89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0ad expref: 52 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.397530:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690565.397761:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+51:109920:x1866137503738624:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2817us (3101us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.397769:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 856 00000100:00100000:1.0:1779690565.408628:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.408791:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503738880 00000100:00100000:2.0:1779690565.408842:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503738880 00000100:00100000:2.0:1779690565.408901:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 857 00000100:00100000:2.0:1779690565.408911:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:109920:x1866137503738880:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:2.0:1779690565.408968:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690565.408993:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f6e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee013 expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.409012:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:2.0:1779690565.409017:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690565.409587:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.409603:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 52 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.409612:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.409646:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 52 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.409660:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 52 pid: 57559 timeout: 3392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.409674:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492350208:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690565.409905:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690565.419346:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492350208:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690565.419378:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.425234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.426469:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739008 00000100:00100000:3.0:1779690565.426479:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739008 00010000:00010000:3.0:1779690565.426751:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 53 pid: 57559 timeout: 3392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.427664:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3281 00000100:00100000:3.0:1779690565.427676:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+53:2392:x1866137503739008:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690565.427750:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690565.427758:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 53 pid: 57559 timeout: 3392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427772:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 53 pid: 57559 timeout: 3392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427796:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee028 expref: 53 pid: 57559 timeout: 3392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427826:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:3.0:1779690565.427832:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427841:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427848:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.427878:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690565.427907:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.427918:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.427933:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+52:2392:x1866137503739008:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 260us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.427941:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3281 00010000:00010000:0.0:1779690565.428011:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.428024:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.428032:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690565.430115:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8d:0x0]: returning size 512 00010000:00010000:0.0:1779690565.430130:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430139:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430147:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430152:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690565.430157:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430177:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430191:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e308a642700) 00010000:00010000:0.0:1779690565.430197:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690565.430201:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.430206:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f8b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690565.430226:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f050a61c reply state 00000000340a46bf transno 12884902281 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.430235:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690565.430415:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:109920:x1866137503738880:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 21502us (21790us total) trans 12884902281 rc 0/0 00000100:00100000:1.0:1779690565.430425:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 857 00010000:00010000:3.0:1779690565.432976:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.432994:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.432999:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.433004:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.433006:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.433011:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.433022:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (ffff9e2f8be8c100) 00010000:00010000:3.0:1779690565.433024:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.433027:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.433030:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913f8b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.437344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.437468:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739136 00000100:00100000:3.0:1779690565.437478:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739136 00000100:00100000:3.0:1779690565.437836:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 858 00000100:00100000:3.0:1779690565.437849:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+51:109921:x1866137503739136:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1779690565.437871:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.437893:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0b4 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.437967:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.437980:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.437991:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690565.438054:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690565.438058:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 111 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690565.438094:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.438118:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 53 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.438135:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 52 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.438143:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:3.0:1779690565.438145:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690565.438149:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267600, rc 0) 00000100:00100000:3.0:1779690565.438211:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+52:109921:x1866137503739136:12345-192.168.203.5@tcp:101:bash.0 Request processed in 365us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.438218:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 858 00000100:00100000:0.0:1779690565.440929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.441028:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739264 00000100:00100000:2.0:1779690565.441036:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739264 00000100:00100000:2.0:1779690565.441096:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 859 00000100:00100000:2.0:1779690565.441106:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+52:109921:x1866137503739264:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690565.441125:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.441144:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0bb expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441201:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441213:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441223:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441237:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441256:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441261:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441366:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f8e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441375:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.441381:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690565.442592:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8d:0x0]: returning size 512 00000004:00200000:2.0:1779690565.442600:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690565.442642:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442657:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442665:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442671:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442677:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.442737:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442757:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442771:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:2.0:1779690565.442774:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.442778:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442784:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f8d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442798:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442926:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442933:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442938:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.442941:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442947:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442956:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690565.442958:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.442961:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.442975:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f8dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.443013:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0bb expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.443026:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d600/0xb4bb873a1913f8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0bb expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.443032:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.443034:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690565.443037:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d600, rc 0) 00000100:00100000:2.0:1779690565.443115:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+53:109921:x1866137503739264:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2011us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690565.443124:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 859 00000100:00100000:0.0:1779690565.448318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.448474:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739392 00000100:00100000:1.0:1779690565.448484:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739392 00000100:00100000:1.0:1779690565.448674:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 860 00000100:00100000:1.0:1779690565.448742:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+53:109921:x1866137503739392:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1779690565.448764:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.448784:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0c2 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448878:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448894:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448905:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448919:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448926:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.448931:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449004:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449012:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449031:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449037:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.449041:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449048:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449059:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.449062:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.449066:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449072:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f8f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449094:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449099:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449105:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449109:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.449112:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449126:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449134:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.449136:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.449139:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449144:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f8f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449188:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ea lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0c2 expref: 54 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449197:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.449200:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.449203:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f8ea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0c2 expref: 54 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.449213:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690565.449264:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+53:109921:x1866137503739392:12345-192.168.203.5@tcp:101:bash.0 Request processed in 527us (1095us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.449271:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 860 00000100:00100000:1.0:1779690565.463918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.464008:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739520 00000100:00100000:3.0:1779690565.464018:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739520 00000100:00100000:3.0:1779690565.464097:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 861 00000100:00100000:3.0:1779690565.464108:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+52:109922:x1866137503739520:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690565.464132:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.464153:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0c9 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464213:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464228:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464240:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690565.464304:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1779690565.464308:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 111 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690565.464334:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464359:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0c9 expref: 54 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464374:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0c9 expref: 53 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.464382:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:3.0:1779690565.464384:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690565.464387:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267200, rc 0) 00000100:00100000:3.0:1779690565.464489:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+53:109922:x1866137503739520:12345-192.168.203.5@tcp:101:rm.0 Request processed in 382us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.464502:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 861 00000100:00100000:0.0:1779690565.467002:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.467779:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739648 00000100:00100000:2.0:1779690565.467788:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739648 00000100:00100000:2.0:1779690565.467912:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 862 00000100:00100000:2.0:1779690565.467923:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:109922:x1866137503739648:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690565.467941:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.467960:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f90d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0d0 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468017:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468031:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468054:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468069:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468088:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468095:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468197:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f922 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468206:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468213:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690565.468241:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8d:0x0]: returning size 512 00000004:00200000:2.0:1779690565.468244:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690565.468264:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468276:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468282:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468298:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468304:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.468308:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468316:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468326:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:2.0:1779690565.468329:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.468333:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468339:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468350:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468355:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468361:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468366:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.468369:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468381:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468388:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690565.468390:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.468393:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468398:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f91b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468428:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0d0 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468440:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170c600/0xb4bb873a1913f922 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0d0 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.468447:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.468449:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690565.468451:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170c600, rc 0) 00000100:00100000:2.0:1779690565.469346:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:109922:x1866137503739648:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1423us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690565.469354:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 862 00000100:00100000:0.0:1779690565.476014:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.476172:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739776 00000100:00100000:1.0:1779690565.476182:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739776 00000100:00100000:1.0:1779690565.476228:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 863 00000100:00100000:1.0:1779690565.476239:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:109922:x1866137503739776:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690565.476273:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.476293:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f929 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0d7 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476358:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476374:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476384:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476398:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476405:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476411:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476478:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476485:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476492:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476498:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.476509:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476517:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476528:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.476531:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.476536:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476542:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f930 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476556:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476562:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476567:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476572:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.476575:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476580:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476592:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.476594:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.476602:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476608:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f937 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476638:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f929 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0d7 expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476648:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.476651:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.476654:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913f929 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0d7 expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.476663:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690565.477068:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:109922:x1866137503739776:12345-192.168.203.5@tcp:101:rm.0 Request processed in 831us (1064us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.477084:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 863 00000100:00100000:1.0:1779690565.480662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.480902:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503739904 00000100:00100000:3.0:1779690565.480912:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503739904 00000100:00100000:3.0:1779690565.480982:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 864 00000100:00100000:3.0:1779690565.480991:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:109922:x1866137503739904:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690565.481009:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.481026:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f93e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0de expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481093:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481107:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481117:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481131:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481138:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481144:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481206:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481228:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481234:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481240:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.481244:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481252:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481263:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.481266:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.481270:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481275:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f945 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481288:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481294:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481299:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481304:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.481313:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481319:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481326:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f905adb00) 00010000:00010000:3.0:1779690565.481329:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.481331:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481337:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f94c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481366:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f93e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0de expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481375:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.481377:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.481380:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f93e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0de expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.481388:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:3.0:1779690565.481444:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:109922:x1866137503739904:12345-192.168.203.5@tcp:101:rm.0 Request processed in 454us (791us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690565.481459:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 864 00000100:00100000:0.0:1779690565.496015:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.496123:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740032 00000100:00100000:2.0:1779690565.496132:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740032 00000100:00100000:2.0:1779690565.496271:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 865 00000100:00100000:2.0:1779690565.496282:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:109923:x1866137503740032:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690565.496316:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.496336:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f953 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0e5 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496398:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496413:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496424:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496437:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496445:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496464:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496530:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496537:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496543:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496549:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.496559:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496567:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496578:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.496581:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.496585:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496591:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f95a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496603:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496609:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496614:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496619:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.496622:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496627:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496634:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f826ec600) 00010000:00010000:2.0:1779690565.496636:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.496645:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.496650:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f961 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.497111:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f953 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0e5 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.497123:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.497126:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.497129:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f953 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0e5 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.497139:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690565.497279:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:109923:x1866137503740032:12345-192.168.203.5@tcp:101:cp.0 Request processed in 999us (1270us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.497287:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 865 00000100:00100000:0.0:1779690565.501179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.501283:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740160 00000100:00100000:1.0:1779690565.501292:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740160 00000100:00100000:1.0:1779690565.501347:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 866 00000100:00100000:1.0:1779690565.501358:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:109923:x1866137503740160:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690565.501378:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.501396:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f968 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0ec expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501456:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501487:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501499:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501514:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501521:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501527:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501583:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501590:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501597:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501602:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.501606:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501613:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501623:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.501632:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.501637:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501643:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913f96f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501656:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501662:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501668:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501673:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.501676:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501698:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501706:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.501717:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.501720:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501725:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913f976 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501757:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f968 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0ec expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501777:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.501779:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.501783:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913f968 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0ec expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.501792:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690565.502199:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:109923:x1866137503740160:12345-192.168.203.5@tcp:101:cp.0 Request processed in 841us (1026us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.502207:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 866 00000100:00100000:1.0:1779690565.511405:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.511515:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740416 00000100:00100000:3.0:1779690565.511531:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740416 00000100:00100000:3.0:1779690565.511583:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 867 00000100:00100000:3.0:1779690565.511591:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:109923:x1866137503740416:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690565.511622:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.511640:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f97d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0f3 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511747:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511762:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511773:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511785:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511792:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.511798:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690565.514878:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ee:0x0], index 1: 0 00010000:00010000:2.0:1779690565.515062:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516195:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516209:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516260:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516279:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516286:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516291:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.516594:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516604:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516616:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.516619:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.516623:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516629:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913f984 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690565.516643:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4fcf120 reply state 00000000ddd86307 transno 12884902282 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690565.516651:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690565.516689:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266000/0xb4bb873a1913f97d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516703:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.516724:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690565.516726:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690565.516728:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690565.516794:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:109923:x1866137503740416:12345-192.168.203.5@tcp:101:cp.0 Request processed in 5203us (5398us total) trans 12884902282 rc 0/0 00000100:00100000:2.0:1779690565.516845:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 867 00010000:00010000:3.0:1779690565.520001:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520018:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520026:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520031:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.520047:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520054:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520083:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f905adb00) 00010000:00010000:3.0:1779690565.520087:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.520092:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.520098:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f98b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.521375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.521443:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740544 00000100:00100000:2.0:1779690565.521452:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740544 00000100:00100000:2.0:1779690565.521504:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6459 00000100:00100000:2.0:1779690565.521514:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503740544:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690565.521537:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.521556:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee0fa expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690565.521584:0:15940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1779690565.521602:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690565.521604:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690565.521611:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 12 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.521630:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 12 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.521642:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d800, rc 0) 00000100:00100000:2.0:1779690565.521703:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503740544:12345-192.168.203.5@tcp:101:cp.0 Request processed in 191us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690565.521720:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6459 00000100:00100000:0.0:1779690565.527614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.527732:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740672 00000100:00100000:1.0:1779690565.527742:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740672 00000100:00100000:1.0:1779690565.527905:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6460 00000100:00100000:1.0:1779690565.527917:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+12:109923:x1866137503740672:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690565.527934:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.527952:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee101 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.527982:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 13 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.527990:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690565.527993:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690565.527996:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.528043:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 13 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.528057:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 13 pid: 15940 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.528070:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492350336:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690565.528188:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30925ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690565.532096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.532167:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503740800 00000100:00100000:3.0:1779690565.532175:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503740800 00010000:00010000:3.0:1779690565.532213:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 14 pid: 15940 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.532262:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3282 00000100:00100000:3.0:1779690565.532272:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503740800:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690565.532285:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690565.532367:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 14 pid: 15940 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.532382:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 14 pid: 15940 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.532406:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.532419:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.532427:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.532437:0:17231:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.532483:0:17231:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.532496:0:17231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17231:1866137492350464:192.168.203.5@tcp:105: 00000100:00100000:3.0:1779690565.532731:0:17231:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848ad6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1779690565.533011:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d697a8/0xb4bb873a1913f9a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0fa expref: 14 pid: 15940 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.533028:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492350336:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690565.533052:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.533063:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690565.533105:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:109923:x1866137503740672:12345-192.168.203.5@tcp:101:cp.0 Request processed in 5192us (5499us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690565.533113:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6460 00000100:00100000:3.0:1779690565.534994:0:17231:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17231:1866137492350464:192.168.203.5@tcp:105: 00010000:00010000:3.0:1779690565.535013:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690565.535057:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503740800:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2786us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.535067:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3282 00000100:00100000:0.0:1779690565.538658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.538705:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741056 00000100:00100000:3.0:1779690565.538713:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741056 00000100:00100000:3.0:1779690565.538763:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:3.0:1779690565.538772:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+56:109923:x1866137503741056:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:2.0:1779690565.539706:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+57:109923:x1866137503741056:12345-192.168.203.5@tcp:35:cp.0 Request processed in 931us (1052us total) trans 12884902283 rc 0/0 00000100:00100000:2.0:1779690565.539716:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:0.0:1779690565.565986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.566117:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741184 00000100:00100000:2.0:1779690565.566127:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741184 00000100:00100000:2.0:1779690565.566189:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 868 00000100:00100000:2.0:1779690565.566200:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+53:109926:x1866137503741184:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690565.566220:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.566240:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ae lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee108 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566313:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566335:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566345:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566362:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566369:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566376:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566450:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566457:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566463:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566469:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.566473:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566481:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566493:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.566496:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.566501:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566506:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566518:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566524:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566543:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566554:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812acc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.566558:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566563:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566572:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.566575:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.566577:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566583:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566615:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ae lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee108 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566626:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.566628:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.566632:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ae lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee108 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.566642:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d800, rc 0) 00000100:00100000:2.0:1779690565.566705:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+53:109926:x1866137503741184:12345-192.168.203.5@tcp:101:bash.0 Request processed in 505us (725us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.566712:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 868 00000100:00100000:1.0:1779690565.573788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.573993:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741312 00000100:00100000:3.0:1779690565.574002:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741312 00000100:00100000:3.0:1779690565.574060:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 869 00000100:00100000:3.0:1779690565.574070:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:109927:x1866137503741312:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690565.574105:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.574137:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f9c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee10f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574213:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574228:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574240:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574254:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574262:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574268:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574741:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574750:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574757:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574763:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.574767:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574786:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574798:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.574801:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.574829:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574836:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913f9ca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574849:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574855:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574861:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574867:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.574870:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574876:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574884:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f905adb00) 00010000:00010000:3.0:1779690565.574886:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.574889:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574901:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913f9d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574936:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f9c3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee10f expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574948:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.574951:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.574955:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913f9c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee10f expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.574963:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267a00, rc 0) 00000100:00100000:3.0:1779690565.575065:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:109927:x1866137503741312:12345-192.168.203.5@tcp:101:rm.0 Request processed in 995us (1284us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690565.575082:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 869 00000100:00100000:0.0:1779690565.577739:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.577838:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741440 00000100:00100000:2.0:1779690565.577859:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741440 00000100:00100000:2.0:1779690565.577911:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 870 00000100:00100000:2.0:1779690565.577921:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:109927:x1866137503741440:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690565.577942:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.577960:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee116 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578017:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578031:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578041:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578055:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578061:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578068:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578136:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578144:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578151:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578163:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.578167:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578174:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578184:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.578186:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.578190:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578196:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913f9df lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578206:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578212:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578218:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578223:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.578226:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578231:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578250:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.578253:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.578256:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578261:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578292:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9d8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee116 expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.578310:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.578313:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.578316:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee116 expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.579666:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:2.0:1779690565.579777:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:109927:x1866137503741440:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1856us (2041us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.579787:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 870 00000100:00100000:0.0:1779690565.600021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.600139:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741568 00000100:00100000:2.0:1779690565.600148:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741568 00000100:00100000:2.0:1779690565.600208:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 871 00000100:00100000:2.0:1779690565.600219:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:109928:x1866137503741568:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690565.600250:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.600269:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee11d expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600357:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600371:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600381:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600395:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600402:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600408:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600485:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600493:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600498:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600503:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.600507:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600535:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600548:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.600551:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.600555:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600560:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913f9f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600574:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600579:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600584:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600588:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812acc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.600591:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600595:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600601:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.600603:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.600606:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600618:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913f9fb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600649:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ed lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee11d expref: 58 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600664:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.600666:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.600669:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913f9ed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee11d expref: 58 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.600678:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d800, rc 0) 00000100:00100000:2.0:1779690565.603118:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:109928:x1866137503741568:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2881us (3085us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.603130:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 871 00000100:00100000:0.0:1779690565.607653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.607930:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741696 00000100:00100000:3.0:1779690565.607940:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741696 00000100:00100000:3.0:1779690565.608177:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 872 00000100:00100000:3.0:1779690565.608190:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:109928:x1866137503741696:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690565.608210:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.608357:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913fa02 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee124 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608424:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608438:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608462:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608476:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608483:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608489:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608546:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608554:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608560:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608566:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.608570:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608577:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608587:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.608590:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.608594:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608607:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fa09 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608619:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608625:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608631:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608636:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.608639:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608645:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608652:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f905adb00) 00010000:00010000:3.0:1779690565.608655:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.608657:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608662:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fa10 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608695:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913fa02 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee124 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.608715:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690565.608718:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.608722:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267a00/0xb4bb873a1913fa02 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee124 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.611751:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267a00, rc 0) 00000100:00100000:2.0:1779690565.611900:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:109928:x1866137503741696:12345-192.168.203.5@tcp:101:cp.0 Request processed in 3708us (4251us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.611909:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 872 00000100:00100000:2.0:1779690565.614689:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690565.614907:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503741952 00000100:00100000:0.0:1779690565.614928:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503741952 00000100:00100000:0.0:1779690565.614976:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 873 00000100:00100000:0.0:1779690565.614986:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:109928:x1866137503741952:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690565.615004:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690565.615432:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fa17 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee12b expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615561:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615576:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615588:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615603:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615610:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.615615:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690565.616916:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ef:0x0], index 0: 0 00010000:00010000:0.0:1779690565.617611:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617625:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617647:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617682:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617689:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617695:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617701:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690565.617704:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617711:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617721:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:0.0:1779690565.617724:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690565.617793:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617800:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fa1e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690565.617837:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005fdc5e02 reply state 000000005f511005 transno 12884902284 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.617846:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690565.617885:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fa17 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617897:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.617904:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690565.617906:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690565.617908:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:0.0:1779690565.617980:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:109928:x1866137503741952:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2995us (3298us total) trans 12884902284 rc 0/0 00000100:00100000:0.0:1779690565.617988:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 873 00010000:00010000:3.0:1779690565.622239:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622255:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622263:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622269:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.622339:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622349:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622364:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f8be8ce00) 00010000:00010000:3.0:1779690565.622367:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.622372:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.622378:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a1913fa25 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690565.622533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.622590:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742080 00000100:00100000:3.0:1779690565.622958:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742080 00000100:00100000:3.0:1779690565.623010:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6461 00000100:00100000:3.0:1779690565.623019:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503742080:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690565.623035:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.623051:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee132 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690565.623085:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690565.623102:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.623104:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.623111:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 8 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.623126:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 8 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.623138:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267a00, rc 0) 00000100:00100000:3.0:1779690565.623193:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503742080:12345-192.168.203.5@tcp:101:cp.0 Request processed in 174us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.623200:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6461 00000100:00100000:1.0:1779690565.627029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.627133:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742208 00000100:00100000:3.0:1779690565.627142:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742208 00000100:00100000:3.0:1779690565.627325:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6462 00000100:00100000:3.0:1779690565.627337:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+8:109928:x1866137503742208:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690565.627369:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.627386:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee139 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.627417:0:10273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.627427:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.627429:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.627432:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.627463:0:10273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.627476:0:10273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690565.627490:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492350592:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690565.627627:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848ad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690565.630030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.630124:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492350592:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690565.630155:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.630173:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267c00, rc 0) 00000100:00100000:3.0:1779690565.630241:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:109928:x1866137503742208:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2904us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.630260:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6462 00000100:00100000:0.0:1779690565.634741:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742336 00000100:00100000:0.0:1779690565.634754:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742336 00010000:00010000:0.0:1779690565.634801:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.634988:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3283 00000100:00100000:0.0:1779690565.634999:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503742336:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690565.635014:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690565.635121:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.635135:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.635157:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ed90da4/0xb4bb873a1913fa3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee132 expref: 9 pid: 49882 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.635185:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690565.635187:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690565.635194:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.635203:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.635242:0:7464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.635350:0:7464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7464:1866137492350720:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690565.636311:0:7464:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f934fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1779690565.638243:0:7464:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7464:1866137492350720:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690565.638267:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690565.638350:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503742336:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3353us (8324us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690565.638360:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3283 00000100:00100000:2.0:1779690565.640310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.640994:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742592 00000100:00100000:3.0:1779690565.641003:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742592 00000100:00100000:3.0:1779690565.641057:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:3.0:1779690565.641068:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+59:109928:x1866137503742592:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:3.0:1779690565.641412:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+60:109928:x1866137503742592:12345-192.168.203.5@tcp:35:cp.0 Request processed in 345us (1107us total) trans 12884902285 rc 0/0 00000100:00100000:3.0:1779690565.641421:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:0.0:1779690565.659089:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.659273:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742720 00000100:00100000:2.0:1779690565.659282:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742720 00000100:00100000:2.0:1779690565.659341:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 874 00000100:00100000:2.0:1779690565.659350:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:109753:x1866137503742720:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1779690565.659384:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.659402:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa48 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee140 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659469:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659484:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659495:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659510:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659517:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659523:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659582:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659590:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659596:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659601:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.659611:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659618:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659629:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.659633:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.659638:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659644:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa4f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659781:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659790:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659796:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659801:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.659933:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659942:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659950:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.659953:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.659962:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.659969:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa56 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.660001:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa48 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee140 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.660011:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.660013:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.660017:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa48 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee140 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.660026:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:2.0:1779690565.660099:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:109753:x1866137503742720:12345-192.168.203.5@tcp:101:bash.0 Request processed in 749us (1028us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.660106:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 874 00000100:00100000:1.0:1779690565.672402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.672503:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742848 00000100:00100000:2.0:1779690565.672514:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742848 00000100:00100000:1.0:1779690565.672692:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 875 00000100:00100000:1.0:1779690565.672715:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:109931:x1866137503742848:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690565.672739:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.672757:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa5d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee147 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672850:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672865:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672877:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672893:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672900:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672907:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672961:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672968:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.672975:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673001:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.673006:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673013:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673025:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.673028:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.673032:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673038:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fa64 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673051:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673057:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673063:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673068:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.673070:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673084:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673101:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.673104:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.673107:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673113:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913fa6b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673142:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa5d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee147 expref: 61 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673150:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.673152:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.673156:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa5d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee147 expref: 61 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.673165:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690565.673312:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:109931:x1866137503742848:12345-192.168.203.5@tcp:101:rm.0 Request processed in 599us (919us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.673319:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 875 00000100:00100000:3.0:1779690565.677510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690565.677685:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503742976 00000100:00100000:0.0:1779690565.677695:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503742976 00000100:00100000:2.0:1779690565.680291:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 876 00000100:00100000:2.0:1779690565.680313:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:109931:x1866137503742976:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690565.680334:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.680352:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa72 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee14e expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680419:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680451:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680463:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680477:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680483:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680489:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680550:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680558:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680565:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680571:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.680576:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680583:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680595:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.680606:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.680612:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680618:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fa79 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680631:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680637:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680643:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680648:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812acc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.680651:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680658:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680666:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.680668:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.680671:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680677:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa80 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680708:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa72 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee14e expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680726:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.680728:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.680732:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa72 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee14e expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.680741:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d800, rc 0) 00000100:00100000:2.0:1779690565.680833:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:109931:x1866137503742976:12345-192.168.203.5@tcp:101:rm.0 Request processed in 531us (3387us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.680852:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 876 00000100:00100000:0.0:1779690565.699973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.700067:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743104 00000100:00100000:2.0:1779690565.700088:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743104 00000100:00100000:2.0:1779690565.700276:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 877 00000100:00100000:2.0:1779690565.700288:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:109932:x1866137503743104:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690565.700308:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.700327:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa87 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee155 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700388:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700401:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700412:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700435:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700454:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700462:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700521:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700529:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700535:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700542:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812ad600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.700546:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700554:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700565:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.700568:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.700573:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700579:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fa8e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700592:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700603:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700609:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700614:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.700617:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700623:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700631:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690565.700633:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.700636:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700642:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fa95 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700675:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa87 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee155 expref: 61 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700698:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.700701:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.700704:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fa87 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee155 expref: 61 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.700724:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812acc00, rc 0) 00000100:00100000:2.0:1779690565.700793:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:109932:x1866137503743104:12345-192.168.203.5@tcp:101:cp.0 Request processed in 508us (829us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690565.700800:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 877 00000100:00100000:2.0:1779690565.705247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.705780:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743232 00000100:00100000:1.0:1779690565.705789:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743232 00000100:00100000:1.0:1779690565.705861:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 878 00000100:00100000:1.0:1779690565.705871:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:109932:x1866137503743232:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690565.705890:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.705912:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa9c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee15c expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.705990:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706003:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706013:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706026:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706031:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706037:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706101:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706108:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706115:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706121:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.706125:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706769:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706782:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.706785:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.706791:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.706797:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8a00/0xb4bb873a1913faa3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707252:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707272:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707279:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707285:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690565.707289:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707294:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707303:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f90442900) 00010000:00010000:1.0:1779690565.707306:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.707308:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707323:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913faaa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707362:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa9c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee15c expref: 61 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707372:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690565.707374:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690565.707377:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fa9c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee15c expref: 61 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.707386:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690565.707452:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:109932:x1866137503743232:12345-192.168.203.5@tcp:101:cp.0 Request processed in 1582us (2212us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690565.707460:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 878 00000100:00100000:3.0:1779690565.715661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690565.716121:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743488 00000100:00100000:2.0:1779690565.716131:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743488 00000100:00100000:2.0:1779690565.716198:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 879 00000100:00100000:2.0:1779690565.716209:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:109932:x1866137503743488:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690565.716229:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690565.716247:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fab1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee163 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.716983:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.716999:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.717010:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.717035:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.717042:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.717066:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690565.719131:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ef:0x0], index 1: 0 00010000:00010000:2.0:1779690565.719947:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.719963:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.719973:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720013:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720026:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720033:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720038:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690565.720042:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720049:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720059:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690565.720062:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690565.720085:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720092:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fab8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690565.720115:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004d2c3521 reply state 0000000043369953 transno 12884902286 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690565.720124:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690565.720160:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fab1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 63 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720407:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.720418:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:2.0:1779690565.720420:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690565.720422:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f812ad600, rc 0) 00000100:00100000:2.0:1779690565.720607:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:109932:x1866137503743488:12345-192.168.203.5@tcp:101:cp.0 Request processed in 4390us (4943us total) trans 12884902286 rc 0/0 00000100:00100000:2.0:1779690565.720616:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 879 00010000:00010000:3.0:1779690565.722444:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.722457:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.722464:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.722469:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f812acc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690565.722474:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.722481:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.722495:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f826ecc00) 00010000:00010000:3.0:1779690565.722498:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690565.722513:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.723003:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812acc00/0xb4bb873a1913fabf lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690565.723625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.723908:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743616 00000100:00100000:3.0:1779690565.723918:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743616 00000100:00100000:3.0:1779690565.723997:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6463 00000100:00100000:3.0:1779690565.724007:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503743616:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690565.724030:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690565.724050:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee16a expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690565.724082:0:22279:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690565.724107:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.724109:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690565.724117:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.724131:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690565.724142:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266600, rc 0) 00000100:00100000:3.0:1779690565.724205:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503743616:12345-192.168.203.5@tcp:101:cp.0 Request processed in 199us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690565.724212:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6463 00000100:00100000:0.0:1779690565.728637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690565.728726:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743744 00000100:00100000:1.0:1779690565.728735:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743744 00000100:00100000:1.0:1779690565.728793:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6464 00000100:00100000:1.0:1779690565.728835:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:109932:x1866137503743744:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690565.728856:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690565.728874:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee171 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.728904:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 14 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.728929:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690565.728931:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690565.728935:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee171 expref: 14 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.728967:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 14 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690565.728979:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 14 pid: 22279 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690565.728992:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492350848:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690565.729098:0:22747:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30925ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690565.732229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690565.733202:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503743872 00000100:00100000:0.0:1779690565.733211:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503743872 00010000:00010000:0.0:1779690565.733263:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 15 pid: 22279 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.733318:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3284 00000100:00100000:0.0:1779690565.733329:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503743872:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690565.733343:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690565.733364:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 15 pid: 22279 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.733377:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 15 pid: 22279 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.733398:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690565.733400:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690565.733407:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee171 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.733418:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee171 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690565.733458:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee171 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690565.733471:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5780:1866137492350976:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690565.733557:0:5780:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f934fbc00 going to sleep for 11 seconds 00010000:00010000:2.0:1779690565.735450:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2b52a8/0xb4bb873a1913fad4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee16a expref: 15 pid: 22279 timeout: 3393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690565.735472:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492350848:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690565.735500:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000716d8b3b/0xb4bb873a1913fadb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee171 expref: 14 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690565.735533:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8a00, rc 0) 00000100:00100000:2.0:1779690565.735637:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+14:109932:x1866137503743744:12345-192.168.203.5@tcp:101:cp.0 Request processed in 6835us (7007us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690565.735645:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6464 00000100:00100000:0.0:1779690565.743399:0:5780:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5780:1866137492350976:192.168.203.5@tcp:105: 00010000:00010000:0.0:1779690565.743438:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690565.743542:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503743872:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 10214us (11318us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690565.743552:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3284 00000100:00100000:1.0:1779690565.748873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690565.749652:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744128 00000100:00100000:3.0:1779690565.749676:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744128 00000100:00100000:2.0:1779690565.749835:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:2.0:1779690565.749847:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+62:109932:x1866137503744128:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:2.0:1779690565.750187:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+63:109932:x1866137503744128:12345-192.168.203.5@tcp:35:cp.0 Request processed in 343us (1322us total) trans 12884902287 rc 0/0 00000100:00100000:2.0:1779690565.750195:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00010000:00010000:1.0:1779690566.089628:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690566.282011:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690566.282024:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690566.282078:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 39 count 9 00000040:00080000:1.0:1779690566.282086:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690566.601162:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690566.601227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690566.601388:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690566.601395:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492351232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690566.601419:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601642:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492351488:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.601672:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601692:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1779690566.601698:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492351360:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.601725:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601750:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492351872:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.601771:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601793:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492351744:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.601831:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601847:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690566.601852:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492351616:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.601870:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690566.601902:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351488 00000100:00100000:3.0:1779690566.601908:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351488 00000100:00100000:3.0:1779690566.601952:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351872 00000100:00100000:3.0:1779690566.601955:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351872 00000100:00100000:3.0:1779690566.601970:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351616 00000100:00100000:3.0:1779690566.601973:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351616 00000100:00100000:3.0:1779690566.601988:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1779690566.601995:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602043:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492351488:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690566.602050:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1779690566.602079:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1779690566.602086:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602113:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492351872:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690566.602124:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1779690566.602136:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1779690566.602142:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492351616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602168:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492351616:12345-0@lo:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690566.602174:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1779690566.602194:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690566.602221:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492351616:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602247:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492351872:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602255:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492351488:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602294:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351744 00000100:00100000:3.0:1779690566.602297:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351744 00000100:00100000:3.0:1779690566.602327:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1779690566.602332:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602364:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492351744:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690566.602370:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1779690566.602387:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351360 00000100:00100000:3.0:1779690566.602390:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351360 00000100:00100000:3.0:1779690566.602413:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1779690566.602419:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602447:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492351360:12345-0@lo:400:kworker.0 Request processed in 29us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690566.602453:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1779690566.602483:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690566.602498:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492351744:0@lo:400:kworker.0 00000100:00100000:3.0:1779690566.602515:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492351360:0@lo:400:kworker.0 00000100:00100000:2.0:1779690566.603927:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351104 00000100:00100000:2.0:1779690566.603991:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351104 00000100:00100000:2.0:1779690566.604087:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492351232 00000100:00100000:2.0:1779690566.604091:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492351232 00000100:00100000:2.0:1779690566.604107:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1779690566.604114:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690566.604145:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 619905024 pending 0 free 3761242112 avail 3759144960 00000100:00100000:2.0:1779690566.604207:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690566.604214:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1779690566.604234:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1779690566.604240:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492351232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690566.604258:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742326272 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690566.604284:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492351232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690566.604302:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1779690566.604403:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492351232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690566.604418:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492351104:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1779690566.604606:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1779690567.004200:0:71798:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690567.004208:0:71798:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690567.004743:0:71798:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:2.0:1779690567.004752:0:71798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1779690567.113275:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1779690567.593604:0:71846:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc4212b850 00000004:00000080:1.0:1779690567.593621:0:71846:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e30bf115c00 uarg=0000000000000000 00000004:00000080:1.0:1779690567.593660:0:71846:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e30bf115c00 00000040:00080000:1.0:1779690567.594186:0:71846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].12, 80 off9152 00000004:00000080:1.0:1779690567.594209:0:71846:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl12', mask 0x0 00000004:02000000:1.0:1779690567.594212:0:71846:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690567.651045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690567.651223:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744256 00000100:00100000:2.0:1779690567.651233:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744256 00000100:00100000:2.0:1779690567.651336:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 880 00000100:00100000:2.0:1779690567.651347:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:109973:x1866137503744256:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690567.651367:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690567.651387:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fae2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee178 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651461:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651475:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651488:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651502:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651509:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651522:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651615:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651623:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651630:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690567.651666:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x23:0x0]: returning size 1516 00000004:00200000:2.0:1779690567.651670:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690567.651687:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651698:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651706:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651712:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651718:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651724:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690567.651728:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651743:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651754:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690567.651757:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690567.651762:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651767:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a1913fae9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651779:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651785:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651790:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651794:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690567.651797:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651801:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651825:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e2f826ecc00) 00010000:00010000:2.0:1779690567.651828:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690567.651830:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651841:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913faf0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651869:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1913fae2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee178 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651882:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee178 expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690567.651888:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690567.651891:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690567.651893:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690567.651950:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+54:109973:x1866137503744256:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 605us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690567.651958:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 880 00000100:00080000:0.0:1779690567.653907:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690567.666507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690567.666567:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744384 00000100:00100000:1.0:1779690567.666577:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744384 00000100:00100000:1.0:1779690567.666643:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6465 00000100:00100000:1.0:1779690567.666654:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503744384:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690567.666670:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690567.666685:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fafe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee17f expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690567.666736:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:49882:1866137492352000:192.168.203.5@tcp:106: 00000100:00100000:1.0:1779690567.666837:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8cd30d80 going to sleep for 11 seconds 00000100:00080000:0.0:1779690567.666837:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1779690567.668974:0:49882:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1779690567.668979:0:49882:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb mtime: 0 -> 1779690565 00002000:00010000:3.0:1779690567.668982:0:49882:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb atime: 0 -> 1779690565 00002000:00010000:3.0:1779690567.668987:0:49882:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb ctime: 0 -> 1779690565 00000100:00100000:3.0:1779690567.669012:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:49882:1866137492352000:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690567.669047:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fafe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee17f expref: 9 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.669134:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fafe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee17f expref: 9 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.669146:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:3.0:1779690567.669200:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503744384:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2547us (2700us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690567.669208:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6465 00000100:00100000:0.0:1779690567.673560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690567.676911:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744512 00000100:00100000:3.0:1779690567.676924:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744512 00000100:00100000:3.0:1779690567.676985:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 881 00000100:00100000:3.0:1779690567.676995:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:109973:x1866137503744512:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690567.677013:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690567.677031:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fb05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee186 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677472:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677487:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677498:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690567.677555:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8d:0x0]: returning size 512 00000004:00200000:3.0:1779690567.677560:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690567.677583:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677608:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fb05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee186 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677624:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee186 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690567.677631:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690567.677634:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1779690567.677637:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266600, rc 0) 00000100:00100000:3.0:1779690567.677707:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:109973:x1866137503744512:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 713us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690567.677715:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 881 00000100:00100000:2.0:1779690567.681361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690567.681585:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744640 00000100:00100000:3.0:1779690567.681595:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744640 00000100:00100000:3.0:1779690567.682425:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6466 00000100:00100000:3.0:1779690567.682438:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503744640:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690567.682454:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690567.682471:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed90da4/0xb4bb873a1913fb13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee18d expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690567.682526:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10273:1866137492352128:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690567.682606:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f3f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690567.690182:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10273:1866137492352128:192.168.203.5@tcp:106: 00010000:00010000:0.0:1779690567.690220:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ed90da4/0xb4bb873a1913fb13 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee18d expref: 9 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690567.690244:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed90da4/0xb4bb873a1913fb13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee18d expref: 9 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690567.690257:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267a00, rc 0) 00000100:00100000:0.0:1779690567.690323:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503744640:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 7888us (8971us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690567.690331:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6466 00000100:00100000:0.0:1779690567.694068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690567.694134:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503744896 00000100:00100000:3.0:1779690567.694145:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503744896 00000100:00100000:3.0:1779690567.694199:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 882 00000100:00100000:3.0:1779690567.694208:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:109973:x1866137503744896:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690567.694552:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].39, 136 off13496 00000100:00100000:3.0:1779690567.694641:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:109973:x1866137503744896:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 433us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690567.694650:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 882 00010000:00010000:1.0:1779690568.142037:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690568.335628:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690568.335637:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690568.335679:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 40 count 10 00000040:00080000:3.0:1779690568.335685:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690568.336226:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492352256:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690568.336315:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447b780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690568.343932:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492352256:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690568.344500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.345699:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745024 00000100:00100000:2.0:1779690568.345708:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745024 00000100:00100000:2.0:1779690568.345782:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 883 00000100:00100000:2.0:1779690568.345792:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:109983:x1866137503745024:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690568.345843:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690568.345932:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:109983:x1866137503745024:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 141us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690568.345939:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 883 00000100:00080000:0.0:1779690568.353298:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690568.353866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.355160:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745280 00000100:00100000:2.0:1779690568.355170:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745280 00000100:00100000:2.0:1779690568.355236:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 884 00000100:00100000:2.0:1779690568.355246:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:109983:x1866137503745280:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690568.355266:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690568.355284:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fb1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee194 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.355373:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fb21 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.355387:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fb21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.355398:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fb21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690568.355410:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x23:0x0]: returning size 1516 00010000:00010000:2.0:1779690568.355543:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fb1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee194 expref: 66 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.355560:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fb21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee194 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.355569:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690568.355572:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690568.355576:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:2.0:1779690568.355710:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:109983:x1866137503745280:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 466us (1850us total) trans 12884902288 rc 0/0 00000100:00100000:2.0:1779690568.355716:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 884 00000100:00100000:2.0:1779690568.363622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.363681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.363712:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745536 00000100:00100000:2.0:1779690568.363722:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745536 00000100:00100000:2.0:1779690568.363778:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18679 00000100:00100000:2.0:1779690568.363788:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+65:2389:x1866137503745536:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690568.363829:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690568.363853:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fb21 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee194 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.363869:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690568.363873:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690568.363921:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+64:2389:x1866137503745536:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690568.363928:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18679 00000100:00100000:1.0:1779690568.364113:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745408 00000100:00100000:1.0:1779690568.364118:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745408 00000100:00100000:1.0:1779690568.364166:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6467 00000100:00100000:1.0:1779690568.364174:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503745408:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690568.364206:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.364235:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.364243:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1779690568.364245:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1779690568.364249:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.364279:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.364292:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 13 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690568.364306:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492352384:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690568.364362:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8cd300c0 going to sleep for 11 seconds 00000100:00080000:2.0:1779690568.364604:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690568.373460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690568.373486:0:6588:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745664 00000100:00100000:3.0:1779690568.373493:0:6588:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745664 00002000:00100000:3.0:1779690568.373534:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1ee:0x0] (0->1515) req@ffff9e2f8f150a80 x1866137503745664/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:49/0 lens 2008/0 e 0 to 0 dl 1779690579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690568.373557:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f150a80 with x1866137503745664 ext(0->1515) 00010000:00010000:3.0:1779690568.373566:0:6588:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 14 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690568.373582:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 14 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690568.373589:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e2f8f150a80 00000100:00100000:3.0:1779690568.373611:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:3.0:1779690568.373620:0:6588:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7a1272b-3551-4679-9948-3e2276470519+14:2389:x1866137503745664:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:3.0:1779690568.374104:0:6588:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7a1272b-3551-4679-9948-3e2276470519+16:2389:x1866137503745664:12345-192.168.203.5@tcp:4:cp.0 Request processed in 484us (651us total) trans 4294968446 rc 0/0 00000100:00100000:3.0:1779690568.374112:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00002000:00100000:3.0:1779690568.374119:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1ee:0x0] (0->1515) req@ffff9e2f8f150a80 x1866137503745664/t4294968446(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:49/0 lens 2008/448 e 0 to 0 dl 1779690579 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690568.374127:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f150a80 with x1866137503745664 ext(0->1515) 00010000:00010000:3.0:1779690568.374132:0:6588:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690568.374142:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690568.374150:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e2f8f150a80 00000100:00100000:1.0:1779690568.376399:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492352384:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690568.376426:0:22279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690568.377208:0:71895:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690568.377214:0:71895:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690568.377285:0:71895:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 40 count 10 00000040:00080000:0.0:1779690568.377291:0:71895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690568.380439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690568.380512:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503745792 00000100:00100000:0.0:1779690568.380522:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503745792 00010000:00010000:0.0:1779690568.380558:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690568.380599:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3285 00000100:00100000:0.0:1779690568.380609:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+16:2392:x1866137503745792:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690568.380623:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690568.380645:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.380659:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.380680:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5488b99/0xb4bb873a1913f9a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee101 expref: 16 pid: 6581 timeout: 3395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.380694:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690568.380696:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690568.380701:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.380710:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.380741:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690568.380792:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503745792:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 184us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690568.380832:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3285 00010000:00010000:1.0:1779690568.381260:0:22279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381272:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381310:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381318:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381326:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381332:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690568.381336:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381346:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381358:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.381365:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baf37b80/0xb4bb873a1913fb2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690568.381456:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503745408:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 17282us (17843us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690568.381474:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6467 00000100:00100000:2.0:1779690568.388960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690568.389063:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746048 00000100:00100000:1.0:1779690568.389072:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746048 00000100:00100000:1.0:1779690568.389132:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 885 00000100:00100000:1.0:1779690568.389142:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:109983:x1866137503746048:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690568.389253:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:109983:x1866137503746048:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690568.389261:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 885 00000100:00100000:0.0:1779690568.397985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.398060:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746176 00000100:00100000:2.0:1779690568.398069:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746176 00000100:00100000:2.0:1779690568.398128:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6468 00000100:00100000:2.0:1779690568.398138:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503746176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690568.398164:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690568.398184:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee19b expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690568.398208:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ee:0x0] initial LVB size: 1516, mtime: 0x6a13ec45, atime: 0x0, ctime: 0x6a13ec45, blocks: 0x1 00010000:00010000:2.0:1779690568.398226:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690568.398228:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690568.398241:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 15 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.398259:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 15 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.398271:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690568.398330:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503746176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 194us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690568.398337:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6468 00000100:00100000:2.0:1779690568.404641:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690568.407646:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746432 00000100:00100000:0.0:1779690568.407660:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746432 00000100:00100000:0.0:1779690568.408473:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 886 00000100:00100000:0.0:1779690568.408485:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+64:109983:x1866137503746432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690568.408605:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+64:109983:x1866137503746432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 123us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690568.408613:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 886 00000100:00100000:2.0:1779690568.413396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690568.413457:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746560 00000100:00100000:0.0:1779690568.413467:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746560 00002000:00100000:0.0:1779690568.413525:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ee:0x0] (0->4095) req@ffff9e2f95b5c000 x1866137503746560/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:49/0 lens 488/0 e 0 to 0 dl 1779690579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690568.413536:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95b5c000 with x1866137503746560 ext(0->4095) 00002000:00010000:0.0:1779690568.413542:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f95b5c000 00000100:00100000:0.0:1779690568.413573:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2082 00000100:00100000:0.0:1779690568.413583:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503746560:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1779690568.413769:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503746560:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 187us (380us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1779690568.413777:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2082 00002000:00100000:0.0:1779690568.413784:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1ee:0x0] (0->4095) req@ffff9e2f95b5c000 x1866137503746560/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:49/0 lens 488/4536 e 0 to 0 dl 1779690579 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690568.413791:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f95b5c000 with x1866137503746560 ext(0->4095) 00002000:00010000:0.0:1779690568.413825:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f95b5c000 00000100:00100000:3.0:1779690568.418914:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690568.418961:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746688 00000100:00100000:1.0:1779690568.418971:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746688 00000100:00100000:1.0:1779690568.419030:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 887 00000100:00100000:1.0:1779690568.419040:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:109983:x1866137503746688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690568.419071:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690568.419092:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb3d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1a2 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419125:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419139:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419151:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419242:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb3d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 66 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419272:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.419281:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:1.0:1779690568.419283:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690568.419287:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690568.419346:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:109983:x1866137503746688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 307us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690568.419353:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 887 00000100:00100000:2.0:1779690568.430958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690568.431212:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746816 00000100:00100000:1.0:1779690568.431221:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746816 00000100:00100000:1.0:1779690568.431304:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 888 00000100:00100000:1.0:1779690568.431314:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:109983:x1866137503746816:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690568.431341:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690568.431468:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:109983:x1866137503746816:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 155us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690568.431476:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 888 00000100:00100000:3.0:1779690568.438826:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.438997:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503746944 00000100:00100000:2.0:1779690568.439007:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503746944 00000100:00100000:2.0:1779690568.439063:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6469 00000100:00100000:2.0:1779690568.439074:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2389:x1866137503746944:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690568.439114:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439130:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690568.439132:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690568.439137:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439157:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439203:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439211:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439219:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439225:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690568.439229:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439238:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439252:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.439259:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913fb4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690568.439323:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2389:x1866137503746944:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 251us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690568.439338:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6469 00000100:00100000:2.0:1779690568.443870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690568.444202:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747200 00000100:00100000:1.0:1779690568.444211:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747200 00000100:00100000:1.0:1779690568.444261:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 889 00000100:00100000:1.0:1779690568.444271:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+65:109983:x1866137503747200:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690568.444342:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.444360:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.444377:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.444411:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690568.444435:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 65 pid: 57559 timeout: 3396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690568.444448:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca34000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492352512:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690568.444528:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8cd300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690568.449197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690568.449581:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747328 00000100:00100000:2.0:1779690568.449590:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747328 00010000:00010000:2.0:1779690568.449624:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 66 pid: 57559 timeout: 3396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690568.449656:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3286 00000100:00100000:2.0:1779690568.449666:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+66:2392:x1866137503747328:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690568.449680:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690568.449686:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 66 pid: 57559 timeout: 3396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.449700:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 66 pid: 57559 timeout: 3396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.449723:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690568.449728:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.449737:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.449745:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690568.449763:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690568.449827:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+66:2392:x1866137503747328:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 163us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690568.449840:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3286 00010000:00010000:0.0:1779690568.452299:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb44 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a2 expref: 65 pid: 57559 timeout: 3396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690568.452322:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca34000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492352512:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690568.452343:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.452352:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.452359:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690568.453092:0:57561:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902289 00010000:00010000:0.0:1779690568.453124:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453133:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453140:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453152:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690568.453157:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453212:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453239:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:0.0:1779690568.453242:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690568.453246:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690568.453252:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb52 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690568.453383:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:109983:x1866137503747200:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 9113us (9518us total) trans 12884902290 rc 0/0 00000100:00100000:0.0:1779690568.453393:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 889 00000020:00080000:0.0:1779690568.453398:0:57561:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1779690568.453451:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690568.453456:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690568.453956:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:1.0:1779690568.453964:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690568.456895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690568.457019:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747584 00000100:00100000:0.0:1779690568.457028:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747584 00000100:00100000:0.0:1779690568.457087:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:0.0:1779690568.457097:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+66:109983:x1866137503747584:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690568.457308:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+67:109983:x1866137503747584:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 212us (420us total) trans 12884902291 rc 0/0 00000100:00100000:0.0:1779690568.457316:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:0.0:1779690569.152849:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690569.152897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690569.152939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690569.152969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690569.152996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690569.153162:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747840 00000100:00100000:1.0:1779690569.153178:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747840 00000100:00100000:1.0:1779690569.153252:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748224 00000100:00100000:1.0:1779690569.153255:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748224 00000100:00100000:1.0:1779690569.153293:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:1.0:1779690569.153306:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:2391:x1866137503747840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690569.153408:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:2391:x1866137503747840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 104us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690569.153416:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:1.0:1779690569.153523:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:1.0:1779690569.153536:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2392:x1866137503748224:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690569.153568:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2392:x1866137503748224:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690569.153574:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:3.0:1779690569.153851:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747968 00000100:00100000:3.0:1779690569.153856:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747968 00000100:00100000:3.0:1779690569.153889:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748480 00000100:00100000:3.0:1779690569.153892:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748480 00000100:00100000:3.0:1779690569.153917:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2964 00000100:00100000:3.0:1779690569.153926:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503747968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690569.153964:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503747968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690569.153970:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2964 00000100:00100000:3.0:1779690569.153985:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2965 00000100:00100000:3.0:1779690569.153990:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503748480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690569.154013:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503748480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690569.154019:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2965 00000100:00100000:2.0:1779690569.154294:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503747712 00000100:00100000:2.0:1779690569.154300:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503747712 00000100:00100000:2.0:1779690569.154346:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:2.0:1779690569.154353:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503747712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690569.154394:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503747712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690569.154401:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00080000:2.0:1779690569.154440:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690569.154445:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690569.154448:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690569.154966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690569.155006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690569.157866:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748096 00000100:00100000:0.0:1779690569.157884:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748096 00000100:00100000:0.0:1779690569.158047:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748352 00000100:00100000:0.0:1779690569.158070:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748352 00000100:00080000:1.0:1779690569.159332:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690569.159744:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2966 00000100:00100000:3.0:1779690569.159758:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2967 00000100:00100000:0.0:1779690569.159771:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503748096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690569.159777:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503748352:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690569.159966:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503748352:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 197us (4957us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690569.159975:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2967 00000100:00100000:0.0:1779690569.160791:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503748096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1029us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690569.160801:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2966 00010000:00010000:1.0:1779690569.161782:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690570.035360:0:71946:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690570.035370:0:71946:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690570.035444:0:71946:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 40 count 10 00000040:00080000:1.0:1779690570.035453:0:71946:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690570.084771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.084920:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748608 00000100:00100000:1.0:1779690570.084933:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748608 00000100:00100000:1.0:1779690570.085000:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 890 00000100:00100000:1.0:1779690570.085012:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+55:109992:x1866137503748608:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690570.085049:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.085075:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb59 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1a9 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085154:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085174:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085188:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085207:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085233:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085241:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085369:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085379:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085386:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690570.085429:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x24:0x0]: returning size 1516 00000004:00200000:1.0:1779690570.085435:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690570.085458:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085471:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085480:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085486:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085494:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085510:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.085515:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085524:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085537:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690570.085540:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.085546:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085553:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fb60 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085572:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085782:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085789:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085795:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.085798:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085840:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085860:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f90442000) 00010000:00010000:1.0:1779690570.085863:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.085866:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085872:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fb67 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085908:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fb59 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a9 expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085921:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a9 expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.085929:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690570.085931:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690570.085934:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:1.0:1779690570.086010:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+56:109992:x1866137503748608:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1002us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.086018:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 890 00000100:00100000:1.0:1779690570.098503:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.099989:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748736 00000100:00100000:3.0:1779690570.100025:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748736 00000100:00100000:3.0:1779690570.100118:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6470 00000100:00100000:3.0:1779690570.100132:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503748736:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690570.100154:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690570.100179:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913fb75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1b0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690570.100261:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492352640:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690570.100389:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f3f5900 going to sleep for 11 seconds 00002000:00010000:0.0:1779690570.110437:0:40949:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x240000400:0x1ef:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1779690570.110519:0:40949:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x240000400:0x1ef:0x0] updating lvb mtime: 0 -> 1779690565 00002000:00010000:0.0:1779690570.110522:0:40949:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x240000400:0x1ef:0x0] updating lvb atime: 0 -> 1779690565 00002000:00010000:0.0:1779690570.110524:0:40949:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x1ef:0x0] updating lvb ctime: 0 -> 1779690565 00000100:00100000:0.0:1779690570.110556:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:40949:1866137492352640:192.168.203.5@tcp:106: 00010000:00010000:0.0:1779690570.110602:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913fb75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1b0 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.110632:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7eeb9e3/0xb4bb873a1913fb75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1b0 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.110643:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266000, rc 0) 00000100:00100000:0.0:1779690570.110716:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503748736:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 10587us (12226us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690570.110726:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6470 00000100:00100000:0.0:1779690570.116613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.116685:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503748864 00000100:00100000:2.0:1779690570.116696:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503748864 00000100:00100000:2.0:1779690570.116761:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6471 00000100:00100000:2.0:1779690570.116775:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503748864:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690570.116798:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690570.116857:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fb7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1b7 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.116932:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492352768:192.168.203.5@tcp:106: 00000100:00100000:2.0:1779690570.117045:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f818300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690570.119995:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492352768:192.168.203.5@tcp:106: 00010000:00010000:3.0:1779690570.120062:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fb7c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1b7 expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.120092:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fb7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1b7 expref: 18 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.120107:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f200, rc 0) 00000100:00100000:3.0:1779690570.120184:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503748864:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3412us (3584us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690570.120195:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6471 00000100:00100000:3.0:1779690570.127102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.127527:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749120 00000100:00100000:0.0:1779690570.127539:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749120 00000100:00100000:0.0:1779690570.127639:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 891 00000100:00100000:0.0:1779690570.127651:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+56:109992:x1866137503749120:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1779690570.128139:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].40, 136 off13632 00000100:00100000:0.0:1779690570.128264:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+56:109992:x1866137503749120:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 614us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.128274:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 891 00010000:00010000:1.0:1779690570.191751:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690570.306761:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968446 is committed 00000001:00080000:3.0:1779690570.337485:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902291 is committed 00000001:00080000:3.0:1779690570.337510:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902281 is committed 00000040:00080000:2.0:1779690570.506776:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690570.506785:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690570.506850:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 41 count 11 00000040:00080000:2.0:1779690570.506857:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690570.507387:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492352896:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690570.507510:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81830b40 going to sleep for 11 seconds 00000100:00100000:3.0:1779690570.515250:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.515344:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492352896:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690570.515501:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749248 00000100:00100000:1.0:1779690570.515509:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749248 00000100:00100000:1.0:1779690570.515573:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 892 00000100:00100000:1.0:1779690570.515585:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:110002:x1866137503749248:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690570.515618:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x24:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690570.515722:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:110002:x1866137503749248:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 139us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.515729:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 892 00000100:00080000:1.0:1779690570.515750:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690570.518616:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.518703:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749504 00000100:00100000:0.0:1779690570.518711:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749504 00000100:00100000:0.0:1779690570.518795:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 893 00000100:00100000:0.0:1779690570.518871:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+56:110002:x1866137503749504:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690570.518889:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690570.518909:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fb83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1be expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.519080:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fb8a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.519096:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fb8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.519108:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fb8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690570.519118:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x24:0x0]: returning size 1516 00010000:00010000:0.0:1779690570.519332:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fb83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1be expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.519348:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fb8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1be expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.519371:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690570.519373:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690570.519377:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ee00, rc 0) 00000100:00100000:0.0:1779690570.519532:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110002:x1866137503749504:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 729us (923us total) trans 12884902292 rc 0/0 00000100:00100000:0.0:1779690570.519538:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 893 00000100:00100000:1.0:1779690570.524124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.524164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.524236:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749760 00000100:00100000:0.0:1779690570.524245:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749760 00000100:00100000:0.0:1779690570.524311:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6472 00000100:00100000:0.0:1779690570.524331:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503749760:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690570.524376:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.524397:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.524404:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690570.524406:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1779690570.524410:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.524457:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.524471:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 8 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690570.524499:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492353024:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690570.524579:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f934fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1779690570.525439:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749632 00000100:00100000:3.0:1779690570.525453:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749632 00000100:00100000:3.0:1779690570.525560:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18680 00000100:00100000:3.0:1779690570.525570:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+58:2391:x1866137503749632:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690570.525584:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690570.525611:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fb8a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1be expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.525627:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:3.0:1779690570.525632:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690570.525669:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503749632:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 101us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690570.525677:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18680 00000100:00100000:1.0:1779690570.528785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.528860:0:37917:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503749888 00000100:00100000:3.0:1779690570.528867:0:37917:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503749888 00002000:00100000:3.0:1779690570.528910:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x1ef:0x0] (0->1515) req@ffff9e2f8ca34380 x1866137503749888/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:51/0 lens 2008/0 e 0 to 0 dl 1779690581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690570.528920:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8ca34380 with x1866137503749888 ext(0->1515) 00010000:00010000:3.0:1779690570.528928:0:37917:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 9 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.528944:0:37917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 9 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690570.528951:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f8ca34380 00000100:00100000:3.0:1779690570.528982:0:37917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:3.0:1779690570.528992:0:37917:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503749888:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:2.0:1779690570.529396:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492353024:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690570.529428:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690570.529977:0:37917:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b7a1272b-3551-4679-9948-3e2276470519+11:2392:x1866137503749888:12345-192.168.203.5@tcp:4:cp.0 Request processed in 984us (1199us total) trans 4294968350 rc 0/0 00000100:00100000:3.0:1779690570.529987:0:37917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00002000:00100000:3.0:1779690570.529996:0:37917:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x1ef:0x0] (0->1515) req@ffff9e2f8ca34380 x1866137503749888/t4294968350(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:51/0 lens 2008/448 e 0 to 0 dl 1779690581 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690570.530005:0:37917:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8ca34380 with x1866137503749888 ext(0->1515) 00010000:00010000:3.0:1779690570.530012:0:37917:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.530041:0:37917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690570.530048:0:37917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e2f8ca34380 00000100:00100000:1.0:1779690570.532764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.532854:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750016 00000100:00100000:2.0:1779690570.532862:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750016 00010000:00010000:2.0:1779690570.532894:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690570.533080:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3287 00000100:00100000:1.0:1779690570.533090:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+11:2390:x1866137503750016:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690570.533104:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690570.533150:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.533195:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.533218:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006837ea40/0xb4bb873a1913fa41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee139 expref: 11 pid: 10273 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.533232:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690570.533234:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690570.533239:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.533254:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.533294:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690570.533334:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503750016:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 246us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.533341:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3287 00010000:00010000:2.0:1779690570.533432:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533442:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533464:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533472:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533480:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533498:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690570.533502:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533512:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533522:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.533530:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002371a652/0xb4bb873a1913fb98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.533606:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503749760:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 9286us (9440us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690570.533613:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6472 00000100:00100000:2.0:1779690570.539631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.539792:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750272 00000100:00100000:0.0:1779690570.539802:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750272 00000100:00100000:0.0:1779690570.539872:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 894 00000100:00100000:0.0:1779690570.539883:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:110002:x1866137503750272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690570.540108:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:110002:x1866137503750272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 225us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.540116:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 894 00000100:00100000:1.0:1779690570.543645:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.544135:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750400 00000100:00100000:2.0:1779690570.544144:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750400 00000100:00100000:2.0:1779690570.544200:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6473 00000100:00100000:2.0:1779690570.544210:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503750400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690570.544227:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690570.544250:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1c5 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690570.544291:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ef:0x0] initial LVB size: 1516, mtime: 0x6a13ec45, atime: 0x0, ctime: 0x6a13ec45, blocks: 0x1 00010000:00010000:2.0:1779690570.544308:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690570.544311:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690570.544319:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.544336:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.544358:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ec00, rc 0) 00000100:00100000:2.0:1779690570.544420:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503750400:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 211us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690570.544436:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6473 00000100:00100000:2.0:1779690570.547224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.547350:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750656 00000100:00100000:1.0:1779690570.547358:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750656 00000100:00100000:1.0:1779690570.547420:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 895 00000100:00100000:1.0:1779690570.547431:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:110002:x1866137503750656:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690570.547539:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:110002:x1866137503750656:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.547546:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 895 00000100:00100000:1.0:1779690570.550609:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.550879:0:37918:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750784 00000100:00100000:3.0:1779690570.550888:0:37918:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750784 00002000:00100000:3.0:1779690570.550934:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1ef:0x0] (0->4095) req@ffff9e30bf4d5500 x1866137503750784/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:51/0 lens 488/0 e 0 to 0 dl 1779690581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690570.550944:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf4d5500 with x1866137503750784 ext(0->4095) 00002000:00010000:3.0:1779690570.550950:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30bf4d5500 00000100:00100000:3.0:1779690570.550982:0:37918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2083 00000100:00100000:3.0:1779690570.550992:0:37918:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503750784:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1779690570.554003:0:37918:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503750784:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 3003us (3393us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1779690570.554017:0:37918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2083 00002000:00100000:3.0:1779690570.554053:0:37918:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1ef:0x0] (0->4095) req@ffff9e30bf4d5500 x1866137503750784/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:51/0 lens 488/4536 e 0 to 0 dl 1779690581 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690570.554063:0:37918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30bf4d5500 with x1866137503750784 ext(0->4095) 00002000:00010000:3.0:1779690570.554068:0:37918:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30bf4d5500 00000100:00100000:2.0:1779690570.568343:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.568425:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503750912 00000100:00100000:1.0:1779690570.568434:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503750912 00000100:00100000:1.0:1779690570.568495:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 896 00000100:00100000:1.0:1779690570.568505:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110002:x1866137503750912:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690570.568524:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.568543:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fba6 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1cc expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568577:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568590:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568608:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568693:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568710:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.568718:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690570.568721:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690570.568724:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:1.0:1779690570.568774:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110002:x1866137503750912:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 271us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.568781:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 896 00000100:00100000:2.0:1779690570.575051:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.575239:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751040 00000100:00100000:1.0:1779690570.575248:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751040 00000100:00100000:1.0:1779690570.575303:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 897 00000100:00100000:1.0:1779690570.575312:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110002:x1866137503751040:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690570.575342:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x24:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690570.575448:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110002:x1866137503751040:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 136us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.575456:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 897 00000100:00100000:3.0:1779690570.579585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.579906:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751168 00000100:00100000:2.0:1779690570.579915:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751168 00000100:00100000:2.0:1779690570.579997:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6474 00000100:00100000:2.0:1779690570.580008:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503751168:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690570.580062:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580079:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690570.580081:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690570.580093:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580107:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580147:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580156:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580164:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580170:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690570.580174:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580182:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580196:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.580203:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e8941ec/0xb4bb873a1913fbb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.581305:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503751168:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 1297us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690570.581315:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6474 00000100:00100000:2.0:1779690570.589051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.589184:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751424 00000100:00100000:1.0:1779690570.589193:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751424 00000100:00100000:1.0:1779690570.589245:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 898 00000100:00100000:1.0:1779690570.589262:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110002:x1866137503751424:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690570.589331:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.589347:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.589356:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.589389:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.589403:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 58 pid: 57561 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690570.589417:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492353152:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690570.590427:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8cd30840 going to sleep for 11 seconds 00000100:00100000:1.0:1779690570.599278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.599621:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492353152:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690570.599646:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690570.604510:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751552 00000100:00100000:0.0:1779690570.604522:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751552 00010000:00010000:0.0:1779690570.605932:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 59 pid: 57561 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690570.605978:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3288 00000100:00100000:0.0:1779690570.605988:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503751552:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690570.606002:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690570.606008:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 59 pid: 57561 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606021:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 59 pid: 57561 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606054:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbad lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1cc expref: 59 pid: 57561 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606077:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690570.606082:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606091:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606098:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690570.606130:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690570.606194:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+58:2392:x1866137503751552:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 207us (6925us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.606201:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3288 00010000:00010000:1.0:1779690570.606305:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.606312:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690570.607179:0:57559:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902293 00010000:00010000:1.0:1779690570.607206:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607214:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607227:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607232:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.607237:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607245:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607256:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690570.607259:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690570.607262:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.607269:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a1913fbbb lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690570.607572:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110002:x1866137503751424:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 18310us (18524us total) trans 12884902294 rc 0/0 00000100:00100000:1.0:1779690570.607582:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 898 00000020:00080000:1.0:1779690570.607586:0:57559:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1779690570.607640:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690570.607645:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690570.609460:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:3.0:1779690570.609470:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690570.609500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.609751:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751808 00000100:00100000:0.0:1779690570.609759:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751808 00000100:00100000:0.0:1779690570.609885:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:0.0:1779690570.609897:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110002:x1866137503751808:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690570.610244:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+60:110002:x1866137503751808:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 349us (747us total) trans 12884902295 rc 0/0 00000100:00100000:0.0:1779690570.610252:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000040:00080000:0.0:1779690570.824145:0:72001:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690570.824152:0:72001:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690570.824232:0:72001:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 41 count 11 00000040:00080000:0.0:1779690570.824239:0:72001:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690570.858764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.861123:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503751936 00000100:00100000:1.0:1779690570.861135:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503751936 00000100:00100000:1.0:1779690570.861193:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6475 00000100:00100000:1.0:1779690570.861204:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503751936:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690570.861221:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.861246:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1d3 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.861270:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690570.861273:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690570.861282:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.861302:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.861314:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690570.861372:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503751936:12345-192.168.203.5@tcp:101:rm.0 Request processed in 169us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.861378:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6475 00000100:00100000:1.0:1779690570.862717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.862752:0:6591:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752064 00000100:00100000:1.0:1779690570.862758:0:6591:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752064 00000100:00100000:1.0:1779690570.862825:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3456 00000100:00100000:1.0:1779690570.862835:0:6591:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bcc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:e775ff0e-5641-488a-99d7-1331a4992115+55:2389:x1866137503752064:12345-192.168.203.5@tcp:63:ll_sa.0 00010000:00010000:1.0:1779690570.862860:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.862875:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1da expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862926:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862939:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862957:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862973:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862981:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.862988:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863375:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863384:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863391:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690570.863410:0:6591:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x25:0x0]: returning size 1516 00000004:00200000:1.0:1779690570.863414:0:6591:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690570.863445:0:6591:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863456:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863464:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863480:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863486:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863491:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.863495:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863502:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863514:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690570.863517:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.863521:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863527:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1913fbd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863543:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863549:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863554:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863559:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.863567:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863573:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863580:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f90442500) 00010000:00010000:1.0:1779690570.863583:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.863586:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863591:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913fbd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863624:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a1913fbc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1da expref: 57 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863638:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1da expref: 56 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863645:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:1.0:1779690570.863647:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690570.863650:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e400, rc 0) 00010000:00010000:1.0:1779690570.863654:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.863661:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fbe5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee1e1 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863684:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863692:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.863707:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864328:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864337:0:6591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864346:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864592:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864599:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864605:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864611:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.864614:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864620:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864631:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690570.864633:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.864637:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864649:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fbec lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864663:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864669:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864675:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864680:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690570.864683:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864688:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864695:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5bde7f3d (ffff9e2f90442b00) 00010000:00010000:1.0:1779690570.864698:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690570.864701:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864706:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fbf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x5bde7f3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864729:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fbe5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1e1 expref: 57 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864749:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:1.0:1779690570.864751:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1779690570.864755:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fbe5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1e1 expref: 57 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.864763:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87e00, rc -2) 00000100:00100000:1.0:1779690570.864928:0:6591:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bcc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:e775ff0e-5641-488a-99d7-1331a4992115+56:2389:x1866137503752064:12345-192.168.203.5@tcp:63:ll_sa.0 Request processed in 2093us (2212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1779690570.864937:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3456 00000100:00100000:1.0:1779690570.867987:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.868138:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752320 00000100:00100000:2.0:1779690570.868147:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752320 00000100:00100000:2.0:1779690570.868202:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 899 00000100:00100000:2.0:1779690570.868211:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+56:110003:x1866137503752320:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:2.0:1779690570.868258:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1779690570.868279:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913faf7 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee178 expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868295:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690570.868306:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fb0c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee186 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868316:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690570.868320:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690570.868340:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868352:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868369:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868393:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868400:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868407:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868932:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690570.868938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:2.0:1779690570.868944:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868952:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868983:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.868996:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 59 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.869011:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492353280:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690570.869014:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752448 00000100:00100000:1.0:1779690570.869018:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752448 00000100:00100000:1.0:1779690570.869224:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6476 00000100:00100000:2.0:1779690570.869226:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81830900 going to sleep for 11 seconds 00000100:00100000:1.0:1779690570.869231:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503752448:12345-192.168.203.5@tcp:101:ll_agl.0 00010000:00010000:1.0:1779690570.869242:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690570.869253:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913fc0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee20b expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.869289:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913fc0f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee20b expref: 10 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.869303:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a1913fc0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee20b expref: 10 pid: 10273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690570.869313:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87a00, rc 0) 00000100:00100000:1.0:1779690570.869362:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503752448:12345-192.168.203.5@tcp:101:ll_agl.0 Request processed in 130us (424us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690570.869369:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6476 00000100:00100000:2.0:1779690570.871570:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492353280:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690570.871596:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690570.872240:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.872338:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752576 00000100:00100000:3.0:1779690570.872345:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752576 00010000:00010000:3.0:1779690570.872378:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 60 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690570.872412:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3289 00000100:00100000:3.0:1779690570.872421:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+60:2391:x1866137503752576:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690570.872433:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690570.872439:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 60 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872451:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 60 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872561:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a1913f992 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0f3 expref: 60 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872592:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:3.0:1779690570.872597:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872605:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872612:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.872639:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690570.872688:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503752576:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 267us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690570.872697:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3289 00010000:00010000:2.0:1779690570.872711:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.872720:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690570.873893:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].9, 64 off8840 00000004:00080000:2.0:1779690570.873905:0:57585:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3298448098461ns, next at 3299448095976ns, rc = 0 00010000:00010000:2.0:1779690570.874013:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874039:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874050:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874057:0:57585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874063:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874070:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874093:0:57585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690570.874117:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.874123:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690570.874133:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874133:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.874153:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690570.874153:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.874161:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874162:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690570.874170:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.874173:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.874179:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875162:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690570.875167:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1779690570.875172:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x23:0x0].0x0 (ffff9e2f826ec600) 00010000:00010000:2.0:1779690570.875172:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.875179:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690570.875185:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875186:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fc08 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.875213:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc16 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875213:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875232:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875243:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.875244:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690570.875248:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690570.875251:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690570.875253:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690570.875267:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875274:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875285:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690570.875287:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690570.875290:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690570.875297:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fbfa lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690570.875309:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f0eabb2e reply state 000000000d2090d7 transno 12884902296 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.875319:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690570.875400:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+56:110003:x1866137503752320:12345-192.168.203.5@tcp:36:rm.0 Request processed in 7186us (7414us total) trans 12884902296 rc 0/0 00000100:00100000:2.0:1779690570.875410:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 899 00010000:00010000:3.0:1779690570.878364:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878377:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878385:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878391:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690570.878395:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878402:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878417:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x5e0cd9fa (ffff9e308a642b00) 00010000:00010000:3.0:1779690570.878421:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690570.878425:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690570.878430:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc01 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690570.909834:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.909920:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752704 00000100:00100000:3.0:1779690570.909934:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752704 00000100:00100000:3.0:1779690570.909986:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 900 00000100:00100000:3.0:1779690570.910000:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752704:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690570.910213:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752704:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 218us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690570.910221:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 900 00000100:00100000:1.0:1779690570.917187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.917301:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752832 00000100:00100000:3.0:1779690570.917310:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752832 00000100:00100000:3.0:1779690570.917368:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 901 00000100:00100000:3.0:1779690570.917379:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752832:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1779690570.917524:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690570.917585:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752832:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 208us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690570.917593:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 901 00000100:00100000:2.0:1779690570.926368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.929570:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503752960 00000100:00100000:1.0:1779690570.929580:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503752960 00000100:00100000:1.0:1779690570.929637:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 902 00000100:00100000:1.0:1779690570.929647:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752960:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690570.929783:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690570.929877:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503752960:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 231us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.929885:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 902 00000100:00100000:3.0:1779690570.936907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690570.936939:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753088 00000100:00100000:3.0:1779690570.936947:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753088 00000100:00100000:3.0:1779690570.936995:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 903 00000100:00100000:3.0:1779690570.937003:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753088:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690570.937399:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690570.937724:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753088:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 719us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690570.937734:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 903 00000100:00100000:0.0:1779690570.946410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.946443:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753216 00000100:00100000:0.0:1779690570.946459:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753216 00000100:00100000:0.0:1779690570.946508:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 904 00000100:00100000:0.0:1779690570.946517:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753216:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690570.946613:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753216:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 97us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.946621:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 904 00000100:00100000:3.0:1779690570.955493:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.955903:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753344 00000100:00100000:0.0:1779690570.955913:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753344 00000100:00100000:0.0:1779690570.955970:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 905 00000100:00100000:0.0:1779690570.955981:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753344:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690570.956162:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753344:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 182us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.956170:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 905 00000100:00100000:3.0:1779690570.958687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.958732:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753472 00000100:00100000:1.0:1779690570.958739:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753472 00000100:00100000:1.0:1779690570.958792:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 906 00000100:00100000:1.0:1779690570.958802:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753472:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690570.959002:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753472:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 201us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.959009:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 906 00000100:00100000:0.0:1779690570.962734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690570.963075:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753600 00000100:00100000:2.0:1779690570.963085:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753600 00000100:00100000:3.0:1779690570.963272:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 907 00000100:00100000:3.0:1779690570.963294:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753600:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690570.963614:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110009:x1866137503753600:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 322us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.963767:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 907 00000100:00100000:1.0:1779690570.996332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690570.996560:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753728 00000100:00100000:0.0:1779690570.996569:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753728 00000100:00100000:0.0:1779690570.996690:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 908 00000100:00100000:0.0:1779690570.996705:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753728:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690570.996905:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753728:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 204us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690570.996914:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 908 00000100:00100000:3.0:1779690570.998461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690570.998550:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753856 00000100:00100000:1.0:1779690570.998556:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753856 00000100:00100000:1.0:1779690570.998710:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 909 00000100:00100000:1.0:1779690570.998720:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753856:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1779690570.998890:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690570.998949:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753856:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 231us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690570.998958:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 909 00000100:00100000:1.0:1779690571.000929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.001054:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503753984 00000100:00100000:0.0:1779690571.001067:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503753984 00000100:00100000:0.0:1779690571.001114:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 910 00000100:00100000:0.0:1779690571.001123:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753984:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690571.001394:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690571.001560:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503753984:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 438us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.001998:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 910 00000100:00100000:3.0:1779690571.004391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.004515:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754112 00000100:00100000:0.0:1779690571.004522:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754112 00000100:00100000:0.0:1779690571.004578:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 911 00000100:00100000:0.0:1779690571.004588:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754112:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690571.004725:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690571.004841:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754112:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 254us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.004849:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 911 00000100:00100000:3.0:1779690571.006870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690571.007072:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754240 00000100:00100000:2.0:1779690571.007080:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754240 00000100:00100000:2.0:1779690571.007133:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 912 00000100:00100000:2.0:1779690571.007143:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754240:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690571.007241:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754240:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690571.007258:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 912 00000100:00100000:2.0:1779690571.009247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.010799:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754368 00000100:00100000:0.0:1779690571.010845:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754368 00000100:00100000:0.0:1779690571.010924:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 913 00000100:00100000:0.0:1779690571.010935:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754368:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690571.011117:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754368:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 184us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.011126:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 913 00000100:00100000:1.0:1779690571.016345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690571.016476:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754496 00000100:00100000:3.0:1779690571.016485:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754496 00000100:00100000:3.0:1779690571.016544:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 914 00000100:00100000:3.0:1779690571.016554:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754496:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690571.016757:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754496:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 203us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.016765:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 914 00000100:00100000:3.0:1779690571.018155:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.020344:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754624 00000100:00100000:0.0:1779690571.020357:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754624 00000100:00100000:0.0:1779690571.020425:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 915 00000100:00100000:0.0:1779690571.020434:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754624:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690571.020662:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+59:110017:x1866137503754624:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 228us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.020670:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 915 00000100:00100000:1.0:1779690571.168979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690571.169126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690571.169207:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754880 00000100:00100000:3.0:1779690571.169218:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754880 00000100:00100000:3.0:1779690571.169295:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3457 00000100:00100000:3.0:1779690571.169307:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:e775ff0e-5641-488a-99d7-1331a4992115+55:2390:x1866137503754880:12345-192.168.203.5@tcp:63:ll_sa.0 00010000:00010000:3.0:1779690571.169343:0:41581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690571.169363:0:41581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fc1d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee219 expref: -99 pid: 41581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169415:0:41581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169430:0:41581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169440:0:41581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169481:0:41581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169488:0:41581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169494:0:41581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169596:0:41581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169603:0:41581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169609:0:41581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169616:0:41581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690571.169619:0:41581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169626:0:41581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169637:0:41581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690571.169640:0:41581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690571.169644:0:41581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169650:0:41581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fc24 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169668:0:41581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169673:0:41581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169678:0:41581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169683:0:41581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690571.169686:0:41581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169692:0:41581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169700:0:41581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x381e9245 (ffff9e2f905add00) 00010000:00010000:3.0:1779690571.169703:0:41581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690571.169705:0:41581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169710:0:41581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fc2b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0x381e9245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169738:0:41581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fc1d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee219 expref: 56 pid: 41581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169747:0:41581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:3.0:1779690571.169750:0:41581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1779690571.169759:0:41581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fc1d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee219 expref: 56 pid: 41581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.169768:0:41581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267800, rc -2) 00000100:00100000:3.0:1779690571.169867:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:e775ff0e-5641-488a-99d7-1331a4992115+55:2390:x1866137503754880:12345-192.168.203.5@tcp:63:ll_sa.0 Request processed in 563us (741us total) trans 0 rc -2/-2 00000100:00100000:3.0:1779690571.169875:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3457 00000100:00080000:1.0:1779690571.170162:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690571.170214:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503754752 00000100:00100000:0.0:1779690571.170220:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503754752 00000100:00100000:0.0:1779690571.170259:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 916 00000100:00100000:0.0:1779690571.170266:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:110027:x1866137503754752:12345-192.168.203.5@tcp:101:mv.0 00010000:00010000:0.0:1779690571.170276:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690571.170286:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc32 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee212 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170320:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170329:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170336:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170347:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170354:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170360:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170416:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170430:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170436:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690571.170581:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x25:0x0]: returning size 1516 00000004:00200000:0.0:1779690571.170585:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690571.170621:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170631:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170638:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170644:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170649:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170654:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690571.170657:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170662:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170671:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:0.0:1779690571.170679:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690571.170682:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170688:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc39 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170698:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170704:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170709:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170713:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690571.170716:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170721:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170728:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690571.170730:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690571.170733:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170738:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc40 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170762:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc32 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee212 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170780:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee212 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.170787:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690571.170789:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690571.170791:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690571.171048:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:110027:x1866137503754752:12345-192.168.203.5@tcp:101:mv.0 Request processed in 782us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.171055:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 916 00000100:00100000:1.0:1779690571.174801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690571.174865:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690571.174938:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755008 00000100:00100000:2.0:1779690571.174947:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755008 00000100:00100000:2.0:1779690571.175086:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6477 00000100:00100000:2.0:1779690571.175097:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503755008:12345-192.168.203.5@tcp:101:mv.0 00010000:00010000:2.0:1779690571.175124:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690571.175140:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee220 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.175165:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690571.175168:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690571.175176:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.175193:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.175205:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690571.175254:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2391:x1866137503755008:12345-192.168.203.5@tcp:101:mv.0 Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690571.175261:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6477 00000100:00080000:1.0:1779690571.175475:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690571.180436:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755136 00000100:00100000:3.0:1779690571.180451:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755136 00000100:00100000:3.0:1779690571.180594:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18681 00000100:00100000:3.0:1779690571.180605:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:2392:x1866137503755136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1779690571.180747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690571.180842:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755264 00000100:00100000:2.0:1779690571.180846:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755264 00000100:00100000:2.0:1779690571.180891:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6478 00000100:00100000:2.0:1779690571.180898:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503755264:12345-192.168.203.5@tcp:101:mv.0 00010000:00010000:2.0:1779690571.180925:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690571.180942:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ec0827/0xb4bb873a1913fc55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee227 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.181009:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492353408:192.168.203.5@tcp:106: 00000100:00100000:2.0:1779690571.181118:0:6583:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f81830900 going to sleep for 11 seconds 00000100:00080000:0.0:1779690571.181314:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690571.181370:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690571.181392:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc47 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee212 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.181409:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690571.181413:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690571.181439:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:2392:x1866137503755136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 836us (6573us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.181446:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18681 00002000:00010000:1.0:1779690571.185676:0:6583:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1779690571.185685:0:6583:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb mtime: 0 -> 1779690565 00002000:00010000:1.0:1779690571.185688:0:6583:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb atime: 0 -> 1779690565 00002000:00010000:1.0:1779690571.185690:0:6583:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb ctime: 0 -> 1779690565 00000100:00100000:1.0:1779690571.185715:0:6583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492353408:192.168.203.5@tcp:106: 00010000:00010000:1.0:1779690571.185751:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0ec0827/0xb4bb873a1913fc55 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee227 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.185777:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ec0827/0xb4bb873a1913fc55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee227 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.185790:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:1.0:1779690571.186133:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503755264:12345-192.168.203.5@tcp:101:mv.0 Request processed in 5233us (5384us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690571.186142:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6478 00000100:00100000:1.0:1779690571.197783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.197985:0:57573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755520 00000100:00100000:0.0:1779690571.197996:0:57573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755520 00000100:00100000:0.0:1779690571.198071:0:57573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1779690571.198083:0:57573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:110027:x1866137503755520:12345-192.168.203.5@tcp:36:mv.0 00010000:00010000:0.0:1779690571.198144:0:57573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1779690571.198280:0:57573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a1913fb6e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1a9 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198468:0:57573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690571.198485:0:57573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913fbde lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1da expref: 54 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198497:0:57573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:0.0:1779690571.198501:0:57573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690571.198535:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198550:0:57573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198560:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198739:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198748:0:57573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198755:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198768:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198775:0:57573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198782:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.198999:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.199009:0:57573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.199043:0:57573:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.199084:0:57573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690571.199098:0:57573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690571.199114:0:57573:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:57573:1866137492353536:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690571.199235:0:57573:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f9447be40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690571.202888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690571.203075:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755648 00000100:00100000:1.0:1779690571.203084:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755648 00010000:00010000:1.0:1779690571.203129:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 59 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690571.203177:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3290 00000100:00100000:1.0:1779690571.203187:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503755648:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690571.203200:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690571.203207:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 59 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.203220:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 59 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.203241:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690571.203246:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.203255:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.203263:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.203281:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690571.203616:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503755648:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 429us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690571.203625:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3290 00010000:00010000:2.0:1779690571.204175:0:57573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fa2c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee12b expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.204193:0:57573:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:57573:1866137492353536:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690571.204217:0:57573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204227:0:57573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204234:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204259:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204270:0:57573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204278:0:57573:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204306:0:57573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.204332:0:57573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 57 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.204345:0:57573:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:57573:1866137492353664:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690571.204544:0:57573:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f818306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690571.207108:0:57573:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:57573:1866137492353664:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690571.207147:0:57573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690571.208515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690571.208592:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755776 00000100:00100000:3.0:1779690571.208600:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755776 00010000:00010000:3.0:1779690571.208635:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690571.208674:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3291 00000100:00100000:3.0:1779690571.208684:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+58:2391:x1866137503755776:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690571.208709:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690571.208717:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208728:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208750:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f812ad600/0xb4bb873a1913fac6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee163 expref: 58 pid: 57560 timeout: 3398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208763:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690571.208768:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208778:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208785:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.208836:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690571.209080:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503755776:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 395us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.209087:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3291 00010000:00010000:2.0:1779690571.209201:0:57573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.209209:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690571.210200:0:57573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].11, 64 off8944 00000004:00080000:2.0:1779690571.210212:0:57573:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3298784406249ns, next at 3299784403666ns, rc = 0 00010000:00010000:2.0:1779690571.210353:0:57573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210363:0:57573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210370:0:57573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210375:0:57573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690571.210379:0:57573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210394:0:57573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210406:0:57573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e2f8be8cd00) 00010000:00010000:2.0:1779690571.210409:0:57573:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1779690571.210413:0:57573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210419:0:57573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fc71 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690571.210438:0:57573:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cb305695 reply state 00000000512398b4 transno 12884902297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.210446:0:57573:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:2.0:1779690571.210452:0:57573:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cb305695 reply state 00000000512398b4 transno 12884902297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.210458:0:57573:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1779690571.210461:0:57573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210466:0:57573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210472:0:57573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210477:0:57573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690571.210479:0:57573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210496:0:57573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210511:0:57573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0x0 (ffff9e2f826eca00) 00010000:00010000:2.0:1779690571.210514:0:57573:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690571.210517:0:57573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210523:0:57573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fc5c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690571.210533:0:57573:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cb305695 reply state 00000000512398b4 transno 12884902297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690571.210538:0:57573:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00010000:2.0:1779690571.210556:0:57573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210567:0:57573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210574:0:57573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210582:0:57573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210587:0:57573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210593:0:57573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690571.210622:0:57573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690571.210697:0:57573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:110027:x1866137503755520:12345-192.168.203.5@tcp:36:mv.0 Request processed in 12614us (12921us total) trans 12884902297 rc 0/0 00000100:00100000:2.0:1779690571.210705:0:57573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00010000:00010000:1.0:1779690571.211136:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1779690571.211148:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.211154:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690571.211157:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.211164:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.211174:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x24:0x0].0x0 (ffff9e308a642f00) 00010000:00010000:1.0:1779690571.211177:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1779690571.211180:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.211185:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fc7f lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690571.211199:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690571.211201:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690571.211202:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690571.211268:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690571.216251:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216268:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216291:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216297:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690571.216302:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216310:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216328:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xf629a772 (ffff9e2f8be8c100) 00010000:00010000:3.0:1779690571.216331:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690571.216336:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216342:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fc63 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216361:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216367:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216373:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216377:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690571.216380:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216396:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216405:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8d:0x0].0xfa5f3888 (ffff9e2f8be8c300) 00010000:00010000:3.0:1779690571.216407:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690571.216410:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216416:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fc6a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8d:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216429:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216434:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216440:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216445:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690571.216447:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216452:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216458:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x25:0x0].0x0 (ffff9e2f826ec300) 00010000:00010000:3.0:1779690571.216460:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1779690571.216463:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690571.216483:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fc78 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x25:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57573 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690571.254917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690571.255095:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503755904 00000100:00100000:2.0:1779690571.255106:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503755904 00000100:00100000:2.0:1779690571.255208:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 917 00000100:00100000:2.0:1779690571.255220:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503755904:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690571.255391:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503755904:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 173us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690571.255398:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 917 00000100:00100000:2.0:1779690571.256945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.257061:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756032 00000100:00100000:0.0:1779690571.257068:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756032 00000100:00100000:0.0:1779690571.257159:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 918 00000100:00100000:0.0:1779690571.257170:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756032:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690571.257319:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690571.257377:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756032:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 210us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.257384:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 918 00000100:00100000:1.0:1779690571.260516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.261214:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756160 00000100:00100000:0.0:1779690571.261224:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756160 00000100:00100000:0.0:1779690571.261342:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 919 00000100:00100000:0.0:1779690571.261354:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756160:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690571.261589:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690571.261732:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756160:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 380us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.261741:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 919 00000100:00100000:3.0:1779690571.267785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690571.269004:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756288 00000100:00100000:2.0:1779690571.269246:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756288 00000100:00100000:2.0:1779690571.269369:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 920 00000100:00100000:2.0:1779690571.269380:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756288:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690571.269541:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690571.269633:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756288:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 255us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690571.269641:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 920 00000100:00100000:3.0:1779690571.273933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.275351:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756416 00000100:00100000:0.0:1779690571.275364:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756416 00000100:00100000:0.0:1779690571.275440:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 921 00000100:00100000:0.0:1779690571.275451:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756416:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690571.275603:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756416:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 153us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.275611:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 921 00000100:00100000:0.0:1779690571.278585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690571.278727:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756544 00000100:00100000:3.0:1779690571.278737:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756544 00000100:00100000:3.0:1779690571.278844:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 922 00000100:00100000:3.0:1779690571.278863:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756544:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690571.279023:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756544:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.279031:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 922 00000100:00100000:1.0:1779690571.285191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690571.285661:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756672 00000100:00100000:0.0:1779690571.285670:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756672 00000100:00100000:0.0:1779690571.285796:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 923 00000100:00100000:0.0:1779690571.285836:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756672:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690571.286095:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756672:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 288us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.286103:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 923 00000100:00100000:0.0:1779690571.297917:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690571.298120:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756800 00000100:00100000:3.0:1779690571.298130:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756800 00000100:00100000:3.0:1779690571.298192:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 924 00000100:00100000:3.0:1779690571.298219:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756800:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690571.298404:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:110033:x1866137503756800:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 202us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.298411:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 924 00000100:00100000:1.0:1779690571.721247:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492353920:0@lo:400:kworker.0 00000100:00100000:1.0:1779690571.721315:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690571.721379:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492354432:0@lo:400:kworker.0 00000100:00100000:1.0:1779690571.721402:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690571.721434:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690571.721440:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492354048:0@lo:400:kworker.0 00000100:00100000:1.0:1779690571.721477:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690571.721694:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492353920 00000100:00100000:0.0:1779690571.721702:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492353920 00000100:00100000:0.0:1779690571.721763:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354432 00000100:00100000:0.0:1779690571.721766:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354432 00000100:00100000:0.0:1779690571.721779:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354048 00000100:00100000:0.0:1779690571.721781:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354048 00000100:00100000:0.0:1779690571.721832:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1779690571.721841:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492353920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.721891:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492353920:12345-0@lo:400:kworker.0 Request processed in 51us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.721898:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1779690571.721913:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1779690571.721918:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492354432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.721941:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492354432:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.721947:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1779690571.721955:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1779690571.721961:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492354048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.721981:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492354048:12345-0@lo:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.721986:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1779690571.722034:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492354048:0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.722046:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492353920:0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.722054:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492354432:0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722141:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492353792:0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722173:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690571.722208:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492354304:0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722232:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690571.722248:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690571.722254:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492354176:0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722282:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690571.722310:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354304 00000100:00100000:3.0:1779690571.722313:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354304 00000100:00100000:3.0:1779690571.722341:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354176 00000100:00100000:3.0:1779690571.722343:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354176 00000100:00100000:3.0:1779690571.722360:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1779690571.722366:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492354304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722399:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492354304:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.722405:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1779690571.722430:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1779690571.722436:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492354176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722471:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492354176:12345-0@lo:400:kworker.0 Request processed in 27us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690571.722478:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1779690571.722510:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492354176:0@lo:400:kworker.0 00000100:00100000:3.0:1779690571.722520:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492354304:0@lo:400:kworker.0 00000100:00080000:1.0:1779690571.722682:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690571.722687:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690571.722689:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690571.722731:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492353792 00000100:00100000:0.0:1779690571.722735:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492353792 00000100:00100000:0.0:1779690571.722769:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1779690571.722775:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492353792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690571.722835:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492353792:12345-0@lo:400:kworker.0 Request processed in 60us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.722850:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1779690571.722950:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492353792:0@lo:400:kworker.0 00000100:00100000:1.0:1779690571.723191:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690571.723201:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492354560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690571.723233:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690571.723366:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492354688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690571.723391:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690571.723556:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354560 00000100:00100000:0.0:1779690571.723560:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354560 00000100:00100000:0.0:1779690571.723590:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354688 00000100:00100000:0.0:1779690571.723593:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354688 00000100:00100000:0.0:1779690571.723605:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1779690571.723611:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492354560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690571.723627:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 744423424 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690571.723659:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492354560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.723665:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1779690571.723677:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1779690571.723684:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492354688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690571.723704:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 621346816 pending 0 free 3761242112 avail 3759144960 00000100:00100000:0.0:1779690571.723729:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492354688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690571.723736:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1779690571.723834:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492354688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690571.723867:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492354560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690572.235662:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690573.257311:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690573.705225:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690573.705232:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690573.705263:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 41 count 11 00000040:00080000:3.0:1779690573.705269:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:00080000:0.0:1779690573.825247:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968350 is committed 00000100:00100000:3.0:1779690574.274041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690574.274082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690574.274085:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503756928 00000100:00100000:2.0:1779690574.274094:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503756928 00000100:00100000:3.0:1779690574.274115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690574.274152:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:3.0:1779690574.274153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690574.274166:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503756928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690574.274185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690574.274206:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690574.274242:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503756928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690574.274251:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:0.0:1779690574.274271:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757184 00000100:00100000:0.0:1779690574.274277:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757184 00000100:00100000:2.0:1779690574.274292:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757696 00000100:00100000:2.0:1779690574.274297:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757696 00000100:00100000:0.0:1779690574.274322:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757312 00000100:00100000:0.0:1779690574.274326:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757312 00000100:00100000:2.0:1779690574.274341:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2970 00000100:00100000:2.0:1779690574.274351:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503757184:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690574.274366:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2971 00000100:00100000:0.0:1779690574.274375:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503757696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690574.274755:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503757184:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 406us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690574.274763:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2970 00000100:00100000:2.0:1779690574.274782:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2972 00000100:00100000:2.0:1779690574.274790:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503757312:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690574.274834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690574.274849:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503757312:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 59us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690574.274856:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2972 00000100:00100000:2.0:1779690574.274867:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757568 00000100:00100000:2.0:1779690574.274871:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757568 00000100:00100000:2.0:1779690574.274897:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2973 00000100:00100000:2.0:1779690574.274903:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503757568:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690574.274929:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503757568:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690574.274935:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2973 00000100:00100000:0.0:1779690574.277467:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503757696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3088us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690574.277483:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2971 00000100:00100000:0.0:1779690574.277512:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757440 00000100:00100000:0.0:1779690574.277517:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757440 00000100:00100000:0.0:1779690574.277552:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757056 00000100:00100000:0.0:1779690574.277556:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757056 00000100:00100000:3.0:1779690574.277571:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00100000:3.0:1779690574.277585:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:2392:x1866137503757440:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690574.277599:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00100000:0.0:1779690574.277609:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503757056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690574.277637:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:2392:x1866137503757440:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 56us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690574.277645:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00100000:0.0:1779690574.277657:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503757056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 48us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690574.277664:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00080000:0.0:1779690574.277705:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690574.277709:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690574.277713:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1779690574.280944:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690575.140961:0:72199:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690575.140967:0:72199:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690575.141031:0:72199:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 13 count 2 00000040:00080000:2.0:1779690575.141036:0:72199:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690575.187266:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690575.187355:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757824 00000100:00100000:0.0:1779690575.187365:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757824 00000100:00100000:0.0:1779690575.187422:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 925 00000100:00100000:0.0:1779690575.187432:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110477:x1866137503757824:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:0.0:1779690575.187473:0:57585:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b3962180 uarg=0000000000000000 00000004:00000080:0.0:1779690575.187509:0:57585:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b3962180 00000004:00000080:0.0:1779690575.187515:0:57585:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=12, endrec=0 00000040:00080000:0.0:1779690575.187595:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690575.189171:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1779690575.189229:0:57585:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl12 endrec = 61 00000040:00080000:0.0:1779690575.189324:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 13 count 2 00000040:00080000:0.0:1779690575.189330:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1779690575.189336:0:57585:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl12 entries up to 18446744073709551615 00000040:00080000:0.0:1779690575.189371:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690575.189374:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1779690575.190317:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 61 count 1 00000040:00080000:0.0:1779690575.190325:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1779690575.190441:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:110477:x1866137503757824:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 3005us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690575.190452:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 925 00010000:00010000:2.0:1779690575.305162:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690575.359905:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902295 is committed 00000001:00080000:1.0:1779690575.359943:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902297 is committed 00000004:00080000:1.0:1779690575.359947:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000004:00080000:1.0:1779690575.359983:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000100:00100000:2.0:1779690575.360564:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690575.360592:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492354816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1779690575.360656:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690575.360657:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690575.360674:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492354944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1779690575.360713:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690575.360743:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354816 00000100:00100000:2.0:1779690575.360751:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354816 00000100:00100000:1.0:1779690575.360751:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492354944 00000100:00100000:1.0:1779690575.360758:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492354944 00000100:00100000:1.0:1779690575.360856:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6479 00000100:00080000:0.0:1779690575.360863:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690575.360868:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492354944:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1779690575.360870:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1779690575.360896:0:15940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:495 count 1 00010000:00010000:1.0:1779690575.360919:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.360942:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.360953:0:15940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 17 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.360994:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690575.360996:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690575.361000:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.361028:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 17 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.361042:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 17 pid: 15940 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690575.361055:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492355072:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690575.361130:0:15940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.361140:0:15940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 7 pid: 6583 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690575.361150:0:15940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492355200:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690575.361850:0:15940:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f2099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690575.362364:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6480 00000100:00100000:2.0:1779690575.362376:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492354816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1779690575.362395:0:22747:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:494 count 1 00010000:00010000:2.0:1779690575.362414:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362429:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 12 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362438:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 8 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362445:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690575.362447:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690575.362450:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362475:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 8 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362501:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 8 pid: 40949 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690575.362514:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492355328:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690575.362564:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 12 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.362573:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 12 pid: 22747 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690575.362582:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492355456:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690575.362602:0:22747:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8eb4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1779690575.370184:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690575.370215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690575.370258:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492355072:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690575.370274:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503757952 00000100:00100000:1.0:1779690575.370275:0:15940:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15940:1866137492355200:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690575.370282:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503757952 00010000:00010000:1.0:1779690575.370306:0:15940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690575.370318:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690575.370361:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758080 00000100:00100000:0.0:1779690575.370365:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758080 00010000:00010000:0.0:1779690575.370380:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 13 pid: 22747 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690575.370407:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3292 00000100:00100000:0.0:1779690575.370416:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2391:x1866137503757952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690575.370433:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690575.370439:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690575.370457:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690575.370478:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6c210b/0xb4bb873a1913fc4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee220 expref: 18 pid: 15940 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690575.370494:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690575.370536:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503757952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690575.370545:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3292 00000100:00100000:1.0:1779690575.370566:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3293 00000100:00100000:1.0:1779690575.370575:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503758080:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690575.370584:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690575.370589:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 13 pid: 22747 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.370601:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 13 pid: 22747 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.370617:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690575.370638:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503758080:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 66us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690575.370693:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492355328:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690575.370705:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913fb36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee19b expref: 13 pid: 22747 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690575.370715:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492355456:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690575.370730:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690575.371389:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690575.371420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690575.371447:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758208 00000100:00100000:3.0:1779690575.371451:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758208 00010000:00010000:3.0:1779690575.371468:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690575.371485:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758336 00000100:00100000:3.0:1779690575.371488:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758336 00010000:00010000:3.0:1779690575.371497:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 8 pid: 6583 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690575.371511:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3294 00000100:00100000:3.0:1779690575.371517:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503758208:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690575.371525:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690575.371529:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371547:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371561:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a1913fbc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1d3 expref: 9 pid: 40949 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371572:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690575.371574:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690575.371578:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371587:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371613:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690575.371636:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+8:2391:x1866137503758208:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690575.371642:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3294 00000100:00100000:3.0:1779690575.371657:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3295 00000100:00100000:3.0:1779690575.371663:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+8:2390:x1866137503758336:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690575.371669:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690575.371673:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 8 pid: 6583 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371693:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 8 pid: 6583 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371706:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141b9c34/0xb4bb873a1913fb9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee1c5 expref: 8 pid: 6583 timeout: 3402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371715:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690575.371716:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690575.371719:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371726:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371742:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690575.371761:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503758336:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690575.371767:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3295 00010000:00010000:3.0:1779690575.371784:0:15940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371792:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371801:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371836:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.371851:0:15940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1779690575.373073:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3293 00000100:00100000:3.0:1779690575.374671:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492354944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13803us (13954us total) trans 4294968351 rc 0/0 00000100:00100000:3.0:1779690575.374682:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6479 00010000:00010000:3.0:1779690575.374708:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690575.374716:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.374727:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690575.374731:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.374740:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.374756:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.374764:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001602db23/0xb4bb873a1913fc86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690575.374782:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690575.374790:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690575.374792:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690575.376362:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690575.376391:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f8d2c0a80/2, rc 0, transno 4294968351 00010000:00010000:2.0:1779690575.376400:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690575.376401:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492354944:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1779690575.376418:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.376427:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690575.376798:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1779690575.376825:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1779690575.376832:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.376840:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690575.376844:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.376854:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.376877:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.376885:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1913fc8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690575.376904:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690575.376906:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690575.376908:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690575.377432:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492354816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15058us (16775us total) trans 4294968447 rc 0/0 00000100:00100000:2.0:1779690575.377442:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6480 00000004:00080000:1.0:1779690575.377578:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f81a20000/2, rc 0, transno 4294968447 00000100:00100000:1.0:1779690575.377585:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492354816:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1779690575.768286:0:72248:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fff8ae80110 00000004:00000080:2.0:1779690575.768302:0:72248:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e3091cc0800 uarg=0000000000000000 00000004:00000080:2.0:1779690575.768341:0:72248:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e3091cc0800 00000004:00000080:2.0:1779690575.768433:0:72248:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=12, endrec=0 00000040:00080000:2.0:1779690575.768528:0:72248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690575.768532:0:72248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1779690575.768563:0:72248:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl12 endrec = 61 00000040:00080000:2.0:1779690575.768716:0:72248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 13 count 2 00000040:00080000:2.0:1779690575.768722:0:72248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690575.768747:0:72248:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl12 entries up to 18446744073709551615 00000040:00080000:2.0:1779690575.768787:0:72248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690575.768790:0:72248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690575.769513:0:72248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690575.769529:0:72248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1779690575.769554:0:72248:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=12 00000040:00080000:2.0:1779690575.769613:0:72248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690575.769616:0:72248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1779690575.769951:0:72248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 12 count 1 00000040:00080000:2.0:1779690575.769957:0:72248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1779690575.769987:0:72248:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1779690575.769989:0:72248:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1779690575.769991:0:72248:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl12 record=18446744073709551615 00000040:00080000:2.0:1779690575.770109:0:72248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1779690575.770113:0:72248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1779690575.770840:0:72248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:2.0:1779690575.770849:0:72248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:3.0:1779690575.771122:0:72248:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690575.771126:0:72248:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690575.772007:0:72248:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690575.772023:0:72248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690576.328925:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690576.385950:0:72296:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690576.385957:0:72296:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690576.386932:0:72296:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690576.386941:0:72296:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1779690576.495730:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690576.495846:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758464 00000100:00100000:3.0:1779690576.495855:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758464 00000100:00100000:3.0:1779690576.495915:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 926 00000100:00100000:3.0:1779690576.495927:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:109919:x1866137503758464:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1779690576.496029:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:109919:x1866137503758464:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 105us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690576.496037:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 926 00000100:00080000:0.0:1779690576.496594:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690576.502324:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690576.502453:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758720 00000100:00100000:3.0:1779690576.502462:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758720 00000100:00100000:3.0:1779690576.502513:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1779690576.502523:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+53:109919:x1866137503758720:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690576.502989:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+54:109919:x1866137503758720:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 467us (672us total) trans 12884902298 rc 0/0 00000100:00100000:3.0:1779690576.502997:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:1.0:1779690576.841016:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492355584:0@lo:400:kworker.0 00000100:00100000:0.0:1779690576.841063:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492355712:0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.841094:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690576.841121:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690576.841166:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492356096:0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.841194:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690576.841217:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492355968:0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.841240:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492355584 00000100:00100000:1.0:1779690576.841248:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492355584 00000100:00100000:2.0:1779690576.841252:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690576.841294:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1779690576.841303:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.841347:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492355584:12345-0@lo:400:kworker.0 Request processed in 46us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690576.841368:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1779690576.841390:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492355840:0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.841417:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492355584:0@lo:400:kworker.0 00000100:00100000:2.0:1779690576.841425:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690576.841458:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492356352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690576.841485:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690576.841519:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492356096 00000100:00100000:3.0:1779690576.841523:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492356096 00000100:00100000:3.0:1779690576.841549:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492355968 00000100:00100000:3.0:1779690576.841551:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492355968 00000100:00100000:3.0:1779690576.841566:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1779690576.841571:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492356096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690576.841604:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492356096:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690576.841617:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1779690576.841631:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:0.0:1779690576.841633:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492356224:0@lo:400:kworker.0 00000100:00100000:3.0:1779690576.841640:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492355968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690576.841673:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690576.841678:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492355968:12345-0@lo:400:kworker.0 Request processed in 39us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690576.841684:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1779690576.841716:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492356096:0@lo:400:kworker.0 00000100:00100000:3.0:1779690576.841726:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690576.841731:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492356480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690576.841751:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690576.841773:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492356352 00000100:00100000:3.0:1779690576.841776:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492356352 00000100:00100000:3.0:1779690576.841794:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492356480 00000100:00100000:3.0:1779690576.841796:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492356480 00000100:00100000:3.0:1779690576.841822:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1779690576.841828:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492356352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690576.841852:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 621346816 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690576.841884:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492356352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690576.841890:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1779690576.841901:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1779690576.841906:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492356480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690576.841923:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742719488 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690576.841946:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492356480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690576.841972:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1779690576.842004:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492356480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690576.842043:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492355968:0@lo:400:kworker.0 00000100:00100000:3.0:1779690576.842069:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492356352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690576.844866:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492355712 00000100:00100000:1.0:1779690576.844877:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492355712 00000100:00100000:1.0:1779690576.844943:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492355840 00000100:00100000:1.0:1779690576.844946:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492355840 00000100:00100000:1.0:1779690576.844996:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492356224 00000100:00100000:1.0:1779690576.844999:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492356224 00000100:00100000:1.0:1779690576.845023:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1779690576.845032:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.845108:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492355712:12345-0@lo:400:kworker.0 Request processed in 78us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690576.845115:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1779690576.845131:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1779690576.845137:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492355840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.845166:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492355840:12345-0@lo:400:kworker.0 Request processed in 29us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690576.845182:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1779690576.845194:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1779690576.845199:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492356224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.845222:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492356224:12345-0@lo:400:kworker.0 Request processed in 23us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690576.845227:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1779690576.845256:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690576.845287:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492355712:0@lo:400:kworker.0 00000100:00100000:1.0:1779690576.845314:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492356224:0@lo:400:kworker.0 00000100:00100000:3.0:1779690576.845472:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492355840:0@lo:400:kworker.0 00010000:00010000:3.0:1779690577.353540:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1779690577.758827:0:72345:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 02:29:36 (1779690576) 00000100:00100000:3.0:1779690577.818691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690577.822524:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503758976 00000100:00100000:1.0:1779690577.822538:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503758976 00000100:00100000:1.0:1779690577.823308:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 927 00000100:00100000:1.0:1779690577.823319:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110658:x1866137503758976:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:1.0:1779690577.823373:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690577.823402:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267200/0xb4bb873a1913f906 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0c9 expref: 54 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.823418:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:1.0:1779690577.823423:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690577.823742:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.823758:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.823768:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.823801:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 51 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.823838:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 51 pid: 57560 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690577.823866:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492356608:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690577.823970:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f2099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690577.830990:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492356608:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690577.830998:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:0.0:1779690577.831024:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690577.831059:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759104 00000100:00100000:3.0:1779690577.831067:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759104 00010000:00010000:3.0:1779690577.831184:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 52 pid: 57560 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690577.831223:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3296 00000100:00100000:3.0:1779690577.831235:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+52:2389:x1866137503759104:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690577.831248:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690577.831255:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 52 pid: 57560 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831267:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 52 pid: 57560 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831288:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913f8c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee0b4 expref: 52 pid: 57560 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831301:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:3.0:1779690577.831312:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831321:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831329:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.831349:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690577.831390:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690577.831398:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+51:2389:x1866137503759104:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 165us (413us total) trans 0 rc 0/0 00010000:00010000:0.0:1779690577.831401:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690577.831407:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3296 00010000:00010000:0.0:1779690577.831433:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690577.831436:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690577.831446:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.831454:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690577.832884:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x26:0x0]: returning size 512 00010000:00010000:0.0:1779690577.832896:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832905:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832912:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832918:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.832922:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832930:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832942:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad600) 00010000:00010000:0.0:1779690577.832945:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.832959:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.832976:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fc94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690577.832996:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ce5bda2f reply state 00000000b5fa9c4e transno 12884902299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690577.833006:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690577.833071:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:110658:x1866137503758976:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 9753us (14386us total) trans 12884902299 rc 0/0 00000100:00100000:0.0:1779690577.833080:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 927 00010000:00010000:1.0:1779690577.837392:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837417:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837425:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837432:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690577.837437:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837444:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837459:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (ffff9e2f8be8cd00) 00010000:00010000:1.0:1779690577.837462:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690577.837466:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690577.837473:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fc9b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690577.841698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690577.841788:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759232 00000100:00100000:3.0:1779690577.841798:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759232 00000100:00100000:2.0:1779690577.841994:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 928 00000100:00100000:2.0:1779690577.842007:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110659:x1866137503759232:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690577.842036:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690577.842060:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee22e expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842140:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842154:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842165:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690577.842219:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690577.842223:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 112 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690577.842246:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842270:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842285:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690577.842293:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:2.0:1779690577.842296:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690577.842300:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690577.842458:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:110659:x1866137503759232:12345-192.168.203.5@tcp:101:rm.0 Request processed in 455us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690577.842466:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 928 00000100:00100000:2.0:1779690577.846662:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690577.846746:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759360 00000100:00100000:3.0:1779690577.846755:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759360 00000100:00100000:0.0:1779690577.846877:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 929 00000100:00100000:0.0:1779690577.846888:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:110659:x1866137503759360:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690577.846916:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690577.847154:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee235 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847216:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847230:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847240:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847255:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847261:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847275:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847382:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fcc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847391:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847398:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690577.847491:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x26:0x0]: returning size 512 00000004:00200000:0.0:1779690577.847495:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690577.847519:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847531:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847537:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847544:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847550:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.847553:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847560:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847576:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:0.0:1779690577.847579:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.847583:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847590:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fcb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847659:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847666:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847672:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847677:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.847680:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847686:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847694:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (ffff9e2f8be8ce00) 00010000:00010000:0.0:1779690577.847696:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.847699:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847705:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fcbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847747:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee235 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847761:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f800/0xb4bb873a1913fcc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee235 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.847768:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.847770:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690577.847773:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f800, rc 0) 00000100:00100000:0.0:1779690577.848196:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:110659:x1866137503759360:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1309us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690577.848204:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 929 00000100:00100000:2.0:1779690577.851493:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690577.851582:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759488 00000100:00100000:0.0:1779690577.851591:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759488 00000100:00100000:0.0:1779690577.851669:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 930 00000100:00100000:0.0:1779690577.851679:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:110659:x1866137503759488:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690577.851698:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690577.851716:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fccc lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee23c expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851774:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851788:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851799:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851843:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851851:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.851858:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852345:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852355:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852361:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852367:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.852371:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852378:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852389:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.852392:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.852396:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852412:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fcd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852429:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852435:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852441:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852446:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.852448:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852454:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852461:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f8be8cd00) 00010000:00010000:0.0:1779690577.852464:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.852466:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852472:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fcda lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852505:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fccc lrc: 1/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee23c expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852515:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.852517:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.852527:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fccc lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee23c expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.852536:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690577.852588:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:110659:x1866137503759488:12345-192.168.203.5@tcp:101:rm.0 Request processed in 909us (1102us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690577.852595:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 930 00000100:00100000:3.0:1779690577.858247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690577.858290:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759616 00000100:00100000:0.0:1779690577.858300:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759616 00000100:00100000:0.0:1779690577.858357:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 931 00000100:00100000:0.0:1779690577.858366:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:110659:x1866137503759616:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690577.858385:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690577.858493:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fce1 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee243 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858554:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858568:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858579:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858596:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858603:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858609:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858674:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858682:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858688:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858694:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.858698:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858705:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858717:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.858720:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.858724:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858729:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fce8 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858739:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858745:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858751:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858761:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.858765:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858771:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858779:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50fa00) 00010000:00010000:0.0:1779690577.858781:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.858784:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858790:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcef lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858849:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fce1 lrc: 1/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee243 expref: 57 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858861:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.858863:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.858867:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fce1 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee243 expref: 57 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.858876:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e000, rc 0) 00000100:00100000:0.0:1779690577.859864:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:110659:x1866137503759616:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1496us (1623us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690577.859873:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 931 00000100:00100000:1.0:1779690577.875466:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690577.875725:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503759872 00000100:00100000:0.0:1779690577.875740:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503759872 00000100:00100000:0.0:1779690577.875794:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 932 00000100:00100000:0.0:1779690577.875821:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+56:110660:x1866137503759872:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1779690577.875842:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690577.875861:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fcf6 lrc: 2/0,0 mode: --/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee24a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876776:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,1 mode: --/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876794:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876825:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876841:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876847:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.876853:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690577.877655:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f0:0x0], index 0: 0 00010000:00010000:0.0:1779690577.877863:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877873:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877889:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877934:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,1 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877941:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 2/0,0 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877956:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,0 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877963:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690577.877966:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 3/0,0 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877973:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 4/0,0 mode: CW/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877985:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690577.877988:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690577.877993:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 2/0,0 mode: --/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.877998:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fcfd lrc: 0/0,0 mode: --/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690577.878009:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e46f496 reply state 000000006026219c transno 12884902300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690577.878018:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690577.878183:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fcf6 lrc: 0/0,0 mode: --/CW res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.878299:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690577.878305:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690577.878307:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690577.878310:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690577.878383:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:110660:x1866137503759872:12345-192.168.203.5@tcp:101:dd.0 Request processed in 2579us (2925us total) trans 12884902300 rc 0/0 00000100:00100000:0.0:1779690577.878390:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 932 00000100:00100000:3.0:1779690577.881283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690577.881314:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881325:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881372:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881379:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690577.881383:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881401:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881416:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50fa00) 00010000:00010000:3.0:1779690577.881420:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690577.881424:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690577.881431:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fd04 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690577.881463:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760128 00000100:00100000:3.0:1779690577.881472:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760128 00000100:00100000:3.0:1779690577.881514:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:3.0:1779690577.881524:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110660:x1866137503760128:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:3.0:1779690577.882355:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+59:110660:x1866137503760128:12345-192.168.203.5@tcp:35:dd.0 Request processed in 829us (1074us total) trans 12884902301 rc 0/0 00000100:00100000:3.0:1779690577.882365:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00010000:00010000:1.0:1779690578.379404:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690578.949073:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968351 is committed 00000040:00080000:0.0:1779690579.121712:0:72442:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1779690579.121719:0:72442:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1779690579.122695:0:72442:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:0.0:1779690579.122706:0:72442:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1779690579.400890:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690579.402103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.402202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.402227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.402247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.402270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.402296:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760256 00000100:00100000:1.0:1779690579.402304:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760256 00000100:00100000:1.0:1779690579.402348:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:1.0:1779690579.402358:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503760256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690579.402423:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503760256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.402430:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:1.0:1779690579.402460:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760384 00000100:00100000:1.0:1779690579.402464:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760384 00000100:00100000:1.0:1779690579.402496:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760768 00000100:00100000:1.0:1779690579.402499:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760768 00000100:00100000:1.0:1779690579.402521:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:1.0:1779690579.402528:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503760384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690579.402564:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503760384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.402569:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:1.0:1779690579.402580:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00100000:1.0:1779690579.402586:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+51:2392:x1866137503760768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690579.402607:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+51:2392:x1866137503760768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.402612:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00100000:1.0:1779690579.402627:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760512 00000100:00100000:1.0:1779690579.402634:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760512 00000100:00100000:1.0:1779690579.402656:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761024 00000100:00100000:1.0:1779690579.402658:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761024 00000100:00100000:1.0:1779690579.402675:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2976 00000100:00100000:1.0:1779690579.402680:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503760512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690579.402701:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503760512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.402706:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2976 00000100:00100000:1.0:1779690579.402714:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2977 00000100:00100000:1.0:1779690579.402718:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503761024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690579.402732:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503761024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 14us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.402737:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2977 00000100:00080000:1.0:1779690579.402867:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690579.402871:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690579.402873:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690579.406668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.406697:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.406722:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760640 00000100:00100000:2.0:1779690579.406730:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760640 00000100:00100000:2.0:1779690579.406778:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2978 00000100:00100000:2.0:1779690579.406787:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503760640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690579.406865:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503760640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.406872:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2978 00000100:00100000:2.0:1779690579.406889:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503760896 00000100:00100000:2.0:1779690579.406892:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503760896 00000100:00100000:2.0:1779690579.406916:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2979 00000100:00100000:2.0:1779690579.406922:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503760896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690579.406958:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2391:x1866137503760896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.406964:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2979 00000100:00080000:2.0:1779690579.406986:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690579.406990:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1779690579.633280:0:72490:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc26b2c4e0 00000004:00000080:2.0:1779690579.633294:0:72490:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e2f95e36400 uarg=0000000000000000 00000004:00000080:2.0:1779690579.633331:0:72490:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e2f95e36400 00000040:00080000:2.0:1779690579.633903:0:72490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x17:0x0].13, 80 off9232 00000004:00000080:2.0:1779690579.633926:0:72490:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl13', mask 0x0 00000004:02000000:2.0:1779690579.633940:0:72490:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1779690579.689218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.689292:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761152 00000100:00100000:0.0:1779690579.689302:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761152 00000100:00100000:0.0:1779690579.689358:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 933 00000100:00100000:0.0:1779690579.689368:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+51:110700:x1866137503761152:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690579.689388:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690579.689407:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee251 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689462:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689475:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689492:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690579.689551:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690579.689555:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 112 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690579.689578:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689602:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee251 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689616:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee251 expref: 52 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.689624:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:0.0:1779690579.689627:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690579.689631:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ee00, rc 0) 00000100:00100000:0.0:1779690579.689688:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+52:110700:x1866137503761152:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 322us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.689694:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 933 00000100:00100000:2.0:1779690579.695222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690579.695341:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761280 00000100:00100000:3.0:1779690579.695350:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761280 00000100:00100000:3.0:1779690579.695434:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 934 00000100:00100000:3.0:1779690579.695445:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+52:110700:x1866137503761280:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690579.695463:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690579.695481:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913fd27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee258 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695595:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695615:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695626:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695640:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695646:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695653:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695753:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fd3c lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695761:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695768:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690579.695798:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x26:0x0]: returning size 512 00000004:00200000:3.0:1779690579.695871:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690579.695896:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695908:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695922:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695929:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695946:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690579.695950:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695957:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695968:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:3.0:1779690579.695971:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690579.695975:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695980:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267800/0xb4bb873a1913fd2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695993:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.695998:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696003:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696008:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690579.696018:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696024:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696031:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (ffff9e2f905ad100) 00010000:00010000:3.0:1779690579.696033:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690579.696036:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696041:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267c00/0xb4bb873a1913fd35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696071:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81267600/0xb4bb873a1913fd27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee258 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696084:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266600/0xb4bb873a1913fd3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee258 expref: 53 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.696091:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:3.0:1779690579.696093:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690579.696096:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81266600, rc 0) 00000100:00100000:3.0:1779690579.696185:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+53:110700:x1866137503761280:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 742us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690579.696192:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 934 00000100:00100000:2.0:1779690579.699581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.700628:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761536 00000100:00100000:0.0:1779690579.700639:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761536 00000100:00100000:0.0:1779690579.700730:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 935 00000100:00100000:0.0:1779690579.700741:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+53:110700:x1866137503761536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690579.700761:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690579.700778:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd43 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee25f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700890:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700904:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700915:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700939:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700946:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.700952:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701061:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701069:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701076:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690579.701085:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690579.701166:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701182:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701188:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701194:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690579.701198:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701205:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701216:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690579.701219:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690579.701223:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701229:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd4a lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701239:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701244:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701250:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701255:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690579.701263:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701269:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701277:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50f200) 00010000:00010000:0.0:1779690579.701279:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690579.701282:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701293:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd51 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701330:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd43 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701342:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.701349:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690579.701351:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690579.701353:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e400, rc 0) 00000100:00100000:0.0:1779690579.701416:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:110700:x1866137503761536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 678us (1842us total) trans 12884902302 rc 0/0 00000100:00100000:0.0:1779690579.701422:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 935 00000100:00100000:2.0:1779690579.709378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.709452:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761792 00000100:00100000:1.0:1779690579.709460:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761792 00000100:00100000:1.0:1779690579.709550:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 936 00000100:00100000:1.0:1779690579.709560:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:110700:x1866137503761792:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:1.0:1779690579.709625:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709643:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709662:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709671:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 5/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709703:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709715:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 55 pid: 57585 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690579.709730:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492356736:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690579.709846:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.709857:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 58 pid: 57561 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690579.709866:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492356864:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690579.709898:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3091c09e40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690579.711762:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492356736:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690579.711773:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492356864:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690579.711794:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690579.716926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.717017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.717649:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762048 00000100:00100000:0.0:1779690579.717658:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762048 00010000:00010000:0.0:1779690579.717700:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 59 pid: 57561 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690579.717750:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503761920 00000100:00100000:0.0:1779690579.717754:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503761920 00010000:00010000:0.0:1779690579.717771:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 56 pid: 57585 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690579.717773:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3297 00000100:00100000:3.0:1779690579.717791:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503762048:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1779690579.717801:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3298 00010000:00010000:3.0:1779690579.717827:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1779690579.717833:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:2392:x1866137503761920:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690579.717844:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 59 pid: 57561 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.717844:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690579.717851:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 56 pid: 57585 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.717863:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 59 pid: 57561 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.718298:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 56 pid: 57585 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.718319:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd58 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee25f expref: 56 pid: 57585 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.718332:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690579.718336:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.718344:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.718351:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690579.718418:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2392:x1866137503761920:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 587us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.718437:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3298 00010000:00010000:3.0:1779690579.719129:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34fc00/0xb4bb873a1913fd0b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee24a expref: 59 pid: 57561 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.719143:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:3.0:1779690579.719147:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.719156:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.719163:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.719197:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690579.719234:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+58:2392:x1866137503762048:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1449us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690579.719242:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3297 00010000:00010000:0.0:1779690579.719644:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.719654:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720245:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720254:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720261:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720267:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690579.720271:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720278:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720289:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690579.720292:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1779690579.720296:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.720302:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fd66 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690579.720410:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:110700:x1866137503761792:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 10851us (11039us total) trans 12884902303 rc 0/0 00000100:00100000:0.0:1779690579.720418:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 936 00000100:00100000:0.0:1779690579.733919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690579.733989:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762304 00000100:00100000:3.0:1779690579.733998:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762304 00000100:00100000:3.0:1779690579.734047:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:3.0:1779690579.734057:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:110700:x1866137503762304:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1779690579.734546:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:110700:x1866137503762304:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 489us (630us total) trans 12884902304 rc 0/0 00000100:00100000:3.0:1779690579.734564:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:2.0:1779690579.786188:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690579.786291:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762432 00000100:00100000:3.0:1779690579.786300:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762432 00000100:00100000:3.0:1779690579.786360:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 937 00000100:00100000:3.0:1779690579.786371:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762432:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690579.786555:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762432:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 185us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690579.786562:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 937 00000100:00100000:3.0:1779690579.789313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.789416:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762560 00000100:00100000:0.0:1779690579.789425:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762560 00000100:00100000:0.0:1779690579.789485:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 938 00000100:00100000:0.0:1779690579.789495:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762560:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690579.789646:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690579.789711:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762560:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 219us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.789718:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 938 00000100:00100000:1.0:1779690579.795333:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.795403:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762688 00000100:00100000:0.0:1779690579.795412:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762688 00000100:00100000:0.0:1779690579.795465:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 939 00000100:00100000:0.0:1779690579.795474:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762688:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690579.795625:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690579.795758:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762688:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 284us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.795766:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 939 00000100:00100000:1.0:1779690579.801594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.801861:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762816 00000100:00100000:2.0:1779690579.801870:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762816 00000100:00100000:2.0:1779690579.801926:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 940 00000100:00100000:2.0:1779690579.801946:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690579.802095:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690579.802176:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762816:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 232us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.802194:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 940 00000100:00100000:2.0:1779690579.805194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.806708:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503762944 00000100:00100000:0.0:1779690579.806718:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503762944 00000100:00100000:0.0:1779690579.806775:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 941 00000100:00100000:0.0:1779690579.806790:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762944:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690579.806941:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503762944:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 148us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.806949:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 941 00000100:00100000:1.0:1779690579.809551:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.809869:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763072 00000100:00100000:0.0:1779690579.809877:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763072 00000100:00100000:0.0:1779690579.809984:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 942 00000100:00100000:0.0:1779690579.809995:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763072:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690579.810148:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763072:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 155us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.810156:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 942 00000100:00100000:1.0:1779690579.812281:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.812434:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763200 00000100:00100000:2.0:1779690579.812442:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763200 00000100:00100000:2.0:1779690579.812487:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 943 00000100:00100000:2.0:1779690579.812495:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763200:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690579.812728:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763200:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 234us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.812736:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 943 00000100:00100000:3.0:1779690579.814520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.814642:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763328 00000100:00100000:0.0:1779690579.814649:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763328 00000100:00100000:0.0:1779690579.814694:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 944 00000100:00100000:0.0:1779690579.814702:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763328:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690579.814925:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110709:x1866137503763328:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 223us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.814943:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 944 00000100:00100000:1.0:1779690579.897046:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.897450:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763584 00000100:00100000:0.0:1779690579.897460:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763584 00000100:00100000:0.0:1779690579.897515:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 945 00000100:00100000:0.0:1779690579.897527:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:110719:x1866137503763584:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690579.897553:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690579.897576:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd6d lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee266 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897666:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897681:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897692:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897706:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897713:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897718:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897853:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897862:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897869:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690579.897877:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690579.897978:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.897995:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.898001:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.898007:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690579.898011:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899534:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899555:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690579.899558:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690579.899564:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899570:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fd74 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899587:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899594:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899599:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899605:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690579.899618:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899625:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899633:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690579.899636:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690579.899639:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899644:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fd7b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899694:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1913fd6d lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899708:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690579.899715:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:0.0:1779690579.899717:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690579.899719:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e800, rc 0) 00000100:00100000:0.0:1779690579.899890:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+58:110719:x1866137503763584:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2364us (2859us total) trans 12884902305 rc 0/0 00000100:00100000:0.0:1779690579.899898:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 945 00000100:00100000:1.0:1779690579.912233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.912999:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763840 00000100:00100000:2.0:1779690579.913009:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763840 00000100:00100000:2.0:1779690579.913172:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 946 00000100:00100000:2.0:1779690579.913182:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:110719:x1866137503763840:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:2.0:1779690579.913249:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690579.913266:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690579.913292:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690579.913340:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 58 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690579.913353:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 58 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690579.913367:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084604e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492356992:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690579.913458:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8a8d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1779690579.919162:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084604e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492356992:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690579.919191:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690579.919600:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690579.919802:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503763968 00000100:00100000:3.0:1779690579.919827:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503763968 00010000:00010000:3.0:1779690579.919861:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 59 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690579.919897:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3299 00000100:00100000:3.0:1779690579.919906:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+59:2392:x1866137503763968:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690579.919921:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690579.919935:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 59 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.919948:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 59 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.919970:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1913fd82 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee266 expref: 59 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.920000:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:3.0:1779690579.920005:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.920014:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.920021:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690579.920056:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690579.920181:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920189:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920678:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920687:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920692:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920698:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690579.920707:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920715:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920725:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:1.0:1779690579.920728:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690579.920732:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690579.920738:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fd90 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690579.921055:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+59:2392:x1866137503763968:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1148us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690579.921063:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3299 00000100:00100000:1.0:1779690579.921133:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:110719:x1866137503763840:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 7953us (8908us total) trans 12884902306 rc 0/0 00000100:00100000:1.0:1779690579.921143:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 946 00000100:00100000:3.0:1779690579.923912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.923991:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764224 00000100:00100000:0.0:1779690579.923998:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764224 00000100:00100000:0.0:1779690579.924156:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:0.0:1779690579.924167:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:110719:x1866137503764224:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1779690579.924790:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:110719:x1866137503764224:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 625us (883us total) trans 12884902307 rc 0/0 00000100:00100000:0.0:1779690579.924798:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:0.0:1779690579.968142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.968206:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764352 00000100:00100000:2.0:1779690579.968215:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764352 00000100:00100000:2.0:1779690579.968311:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 947 00000100:00100000:2.0:1779690579.968321:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764352:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690579.968499:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764352:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 179us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.968515:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 947 00000100:00100000:1.0:1779690579.976113:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.976247:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764480 00000100:00100000:0.0:1779690579.976256:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764480 00000100:00100000:0.0:1779690579.976320:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 948 00000100:00100000:0.0:1779690579.976330:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764480:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690579.976488:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690579.976554:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764480:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 225us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.976562:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 948 00000100:00100000:0.0:1779690579.980034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.980691:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764608 00000100:00100000:1.0:1779690579.980698:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764608 00000100:00100000:1.0:1779690579.980800:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 949 00000100:00100000:1.0:1779690579.980837:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764608:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690579.980981:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690579.981059:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764608:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 226us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.981144:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 949 00000100:00100000:1.0:1779690579.984491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.986333:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764736 00000100:00100000:2.0:1779690579.986346:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764736 00000100:00100000:2.0:1779690579.986440:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 950 00000100:00100000:2.0:1779690579.986450:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764736:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690579.986600:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690579.986691:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764736:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 241us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.986707:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 950 00000100:00100000:2.0:1779690579.988969:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690579.989094:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764864 00000100:00100000:0.0:1779690579.989100:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764864 00000100:00100000:0.0:1779690579.989133:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 951 00000100:00100000:0.0:1779690579.989139:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764864:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690579.989314:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764864:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 173us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690579.989322:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 951 00000100:00100000:3.0:1779690579.991498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690579.991886:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503764992 00000100:00100000:1.0:1779690579.991894:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503764992 00000100:00100000:1.0:1779690579.991964:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 952 00000100:00100000:1.0:1779690579.991974:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764992:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690579.992229:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503764992:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 256us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.992238:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 952 00000100:00100000:1.0:1779690579.996362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690579.996693:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503765120 00000100:00100000:2.0:1779690579.996703:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503765120 00000100:00100000:2.0:1779690579.996755:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 953 00000100:00100000:2.0:1779690579.996767:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503765120:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690579.997006:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503765120:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 242us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690579.997015:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 953 00000100:00100000:2.0:1779690579.999481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690579.999615:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503765248 00000100:00100000:3.0:1779690579.999624:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503765248 00000100:00100000:1.0:1779690579.999769:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 954 00000100:00100000:1.0:1779690579.999781:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503765248:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690579.999989:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110728:x1866137503765248:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 211us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690579.999997:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 954 00000100:00100000:3.0:1779690580.141505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.143763:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503765504 00000100:00100000:0.0:1779690580.143777:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503765504 00000100:00100000:0.0:1779690580.143870:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 955 00000100:00100000:0.0:1779690580.143882:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+59:110740:x1866137503765504:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690580.143906:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690580.143952:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fd97 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee26d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144030:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144046:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144058:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144073:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144081:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144088:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144226:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144235:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144564:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690580.144576:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690580.144690:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144709:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144716:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144722:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.144726:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144734:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144746:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690580.144749:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.144753:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144759:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fd9e lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144773:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144779:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144784:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144790:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.144799:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144851:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144860:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690580.144863:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.144866:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144872:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fda5 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144921:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fd97 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144946:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.144954:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690580.144957:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690580.144959:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690580.145028:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+61:110740:x1866137503765504:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1148us (3532us total) trans 12884902308 rc 0/0 00000100:00100000:0.0:1779690580.145036:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 955 00000100:00100000:0.0:1779690580.151437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.154514:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503765760 00000100:00100000:2.0:1779690580.154528:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503765760 00000100:00100000:2.0:1779690580.154744:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 956 00000100:00100000:2.0:1779690580.154755:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+61:110740:x1866137503765760:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:2.0:1779690580.155156:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.155175:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.155185:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.155220:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.155234:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 61 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690580.155259:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3084607480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492357120:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690580.155412:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8a8d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690580.162197:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3084607480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492357120:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690580.162223:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.167328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.167449:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503765888 00000100:00100000:0.0:1779690580.167458:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503765888 00010000:00010000:0.0:1779690580.167499:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 62 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.167544:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3300 00000100:00100000:0.0:1779690580.167554:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+62:2392:x1866137503765888:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690580.167570:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690580.167576:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 62 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167589:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 62 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167611:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdac lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee26d expref: 62 pid: 57560 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167626:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690580.167632:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167641:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167649:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.167775:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690580.167874:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+61:2392:x1866137503765888:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 321us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.167882:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3300 00010000:00010000:1.0:1779690580.168186:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168195:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168578:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168587:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168594:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168600:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690580.168610:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168618:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168628:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690580.168631:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690580.168634:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.168640:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fdba lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.168738:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+61:110740:x1866137503765760:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 13985us (17776us total) trans 12884902309 rc 0/0 00000100:00100000:1.0:1779690580.168746:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 956 00000100:00100000:1.0:1779690580.170905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.171213:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766144 00000100:00100000:2.0:1779690580.171222:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766144 00000100:00100000:2.0:1779690580.171299:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:2.0:1779690580.171309:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+61:110740:x1866137503766144:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690580.171754:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+62:110740:x1866137503766144:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 445us (851us total) trans 12884902310 rc 0/0 00000100:00100000:2.0:1779690580.171761:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:2.0:1779690580.208139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690580.208227:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766272 00000100:00100000:3.0:1779690580.208237:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766272 00000100:00100000:3.0:1779690580.208293:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 957 00000100:00100000:3.0:1779690580.208303:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766272:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690580.208478:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766272:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 175us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690580.208486:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 957 00000100:00100000:3.0:1779690580.210672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.210863:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766400 00000100:00100000:0.0:1779690580.210871:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766400 00000100:00100000:0.0:1779690580.210934:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 958 00000100:00100000:0.0:1779690580.210943:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766400:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690580.211094:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.211158:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766400:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 216us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.211165:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 958 00000100:00100000:1.0:1779690580.213986:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.214342:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766528 00000100:00100000:0.0:1779690580.214350:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766528 00000100:00100000:0.0:1779690580.214444:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 959 00000100:00100000:0.0:1779690580.214454:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766528:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690580.214593:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.214671:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766528:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 218us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.214678:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 959 00000100:00100000:2.0:1779690580.216412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690580.219096:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766656 00000100:00100000:3.0:1779690580.219109:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766656 00000100:00100000:3.0:1779690580.219187:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 960 00000100:00100000:3.0:1779690580.219199:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766656:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690580.219630:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690580.219851:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766656:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 653us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690580.219860:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 960 00000100:00100000:3.0:1779690580.221999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.223166:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766784 00000100:00100000:1.0:1779690580.223175:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766784 00000100:00100000:1.0:1779690580.223292:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 961 00000100:00100000:1.0:1779690580.223302:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766784:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690580.223427:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766784:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 126us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.223435:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 961 00000100:00100000:1.0:1779690580.225849:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.225953:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503766912 00000100:00100000:0.0:1779690580.225960:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503766912 00000100:00100000:0.0:1779690580.226326:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 962 00000100:00100000:0.0:1779690580.226336:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766912:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690580.226522:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503766912:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 189us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.226536:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 962 00000100:00100000:3.0:1779690580.228266:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.228614:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503767040 00000100:00100000:1.0:1779690580.228623:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503767040 00000100:00100000:1.0:1779690580.228737:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 963 00000100:00100000:1.0:1779690580.228757:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503767040:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690580.228961:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503767040:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 215us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.228966:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 963 00000100:00100000:3.0:1779690580.231633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.231723:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503767168 00000100:00100000:1.0:1779690580.231733:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503767168 00000100:00100000:1.0:1779690580.231872:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 964 00000100:00100000:1.0:1779690580.231883:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503767168:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690580.232071:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aef80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110749:x1866137503767168:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 190us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.232076:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 964 00000100:00100000:3.0:1779690580.356983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.357066:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503767424 00000100:00100000:0.0:1779690580.357076:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503767424 00000100:00100000:0.0:1779690580.357280:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 965 00000100:00100000:0.0:1779690580.357292:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+62:110763:x1866137503767424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690580.357316:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690580.357338:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee274 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357413:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357427:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357438:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357453:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357460:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357466:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357589:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357793:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357849:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690580.357860:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690580.357969:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357978:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357984:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.357989:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.357993:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358000:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358011:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690580.358014:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.358018:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358025:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fdc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358048:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358064:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358070:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358074:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.358077:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358083:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358091:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690580.358094:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.358097:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358102:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fdcf lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358146:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fdc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358160:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.358168:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690580.358170:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690580.358179:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:0.0:1779690580.358245:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+64:110763:x1866137503767424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 955us (1271us total) trans 12884902311 rc 0/0 00000100:00100000:0.0:1779690580.358253:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 965 00000100:00100000:3.0:1779690580.360454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.360629:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503767680 00000100:00100000:0.0:1779690580.360635:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503767680 00000100:00100000:0.0:1779690580.360677:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 966 00000100:00100000:0.0:1779690580.360686:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+64:110763:x1866137503767680:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:0.0:1779690580.360736:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.360751:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.360760:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.360789:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.360833:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 64 pid: 64445 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.360848:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e54000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492357248:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690580.360932:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f209f00 going to sleep for 11 seconds 00000100:00100000:3.0:1779690580.363405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.363584:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e54000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492357248:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690580.363621:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.363736:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503767808 00000100:00100000:1.0:1779690580.363742:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503767808 00010000:00010000:1.0:1779690580.363773:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 65 pid: 64445 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.363827:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3301 00000100:00100000:1.0:1779690580.363836:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+65:2392:x1866137503767808:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690580.363849:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690580.363855:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 65 pid: 64445 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363868:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 65 pid: 64445 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363911:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913fdd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee274 expref: 65 pid: 64445 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363934:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:1.0:1779690580.363938:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363947:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363954:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.363981:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690580.364023:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+64:2392:x1866137503767808:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 188us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.364036:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3301 00010000:00010000:0.0:1779690580.364770:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.364779:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365234:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365243:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365249:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365255:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.365260:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365267:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365279:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690580.365282:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1779690580.365286:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.365292:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913fde4 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.365508:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+64:110763:x1866137503767680:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 4821us (5056us total) trans 12884902312 rc 0/0 00000100:00100000:0.0:1779690580.365525:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 966 00000100:00100000:3.0:1779690580.368001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.368095:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768064 00000100:00100000:0.0:1779690580.368104:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768064 00000100:00100000:0.0:1779690580.368151:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:0.0:1779690580.368160:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+64:110763:x1866137503768064:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1779690580.368879:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:110763:x1866137503768064:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 718us (882us total) trans 12884902313 rc 0/0 00000100:00100000:0.0:1779690580.368887:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:0.0:1779690580.399602:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.399696:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768192 00000100:00100000:1.0:1779690580.399705:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768192 00000100:00100000:1.0:1779690580.399763:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 967 00000100:00100000:1.0:1779690580.399772:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768192:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690580.400011:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768192:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 239us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.400020:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 967 00000100:00100000:3.0:1779690580.402940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.403045:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768320 00000100:00100000:0.0:1779690580.403053:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768320 00000100:00100000:0.0:1779690580.403153:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 968 00000100:00100000:0.0:1779690580.403164:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768320:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690580.403310:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.403385:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768320:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 215us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.403393:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 968 00000100:00100000:3.0:1779690580.406401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.406497:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768448 00000100:00100000:0.0:1779690580.406505:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768448 00000100:00100000:0.0:1779690580.406557:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 969 00000100:00100000:0.0:1779690580.406568:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768448:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690580.406714:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.406795:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768448:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 229us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.406823:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 969 00000100:00100000:3.0:1779690580.408727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.408841:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768576 00000100:00100000:2.0:1779690580.408848:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768576 00000100:00100000:2.0:1779690580.408894:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 970 00000100:00100000:2.0:1779690580.408902:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768576:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690580.409031:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690580.409099:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768576:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 197us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690580.409107:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 970 00000100:00100000:3.0:1779690580.411724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.411829:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768704 00000100:00100000:0.0:1779690580.411837:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768704 00000100:00100000:0.0:1779690580.411877:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 971 00000100:00100000:0.0:1779690580.411885:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768704:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690580.412002:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768704:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.412013:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 971 00000100:00100000:3.0:1779690580.413669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.413784:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768832 00000100:00100000:1.0:1779690580.413790:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768832 00000100:00100000:1.0:1779690580.413950:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 972 00000100:00100000:1.0:1779690580.413971:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768832:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690580.414142:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768832:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 172us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.414150:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 972 00000100:00100000:3.0:1779690580.417241:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.417286:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503768960 00000100:00100000:1.0:1779690580.417294:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503768960 00000100:00100000:1.0:1779690580.417397:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 973 00000100:00100000:1.0:1779690580.417407:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768960:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690580.417579:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503768960:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 174us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.417587:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 973 00000100:00100000:3.0:1779690580.419146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.419247:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503769088 00000100:00100000:0.0:1779690580.419253:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503769088 00000100:00100000:0.0:1779690580.419500:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 974 00000100:00100000:0.0:1779690580.419512:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503769088:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690580.419659:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:110772:x1866137503769088:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 149us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.419667:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 974 00010000:00010000:3.0:1779690580.425052:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690580.457064:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902313 is committed 00000001:00080000:1.0:1779690580.457090:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902300 is committed 00000001:00080000:1.0:1779690580.457115:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902301 is committed 00000001:00080000:2.0:1779690580.471044:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968447 is committed 00000100:00100000:3.0:1779690580.543950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.544420:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503769344 00000100:00100000:1.0:1779690580.544429:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503769344 00000100:00100000:1.0:1779690580.544487:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 975 00000100:00100000:1.0:1779690580.544496:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+53:110788:x1866137503769344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690580.544520:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690580.544539:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fdeb lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee27b expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544605:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544619:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544644:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544658:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544665:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.544671:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545038:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545048:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545054:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690580.545063:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:1.0:1779690580.545173:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545182:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545188:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545194:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690580.545203:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545211:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545222:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:1.0:1779690580.545225:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690580.545229:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545236:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913fdf2 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545247:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545253:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545258:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545263:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690580.545265:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545270:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545277:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f90442800) 00010000:00010000:1.0:1779690580.545280:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690580.545287:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.545293:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fdf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.546441:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fdeb lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.546462:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.546470:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442500) 00010000:00010000:1.0:1779690580.546473:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690580.546476:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86600, rc 0) 00000100:00100000:1.0:1779690580.546536:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+55:110788:x1866137503769344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2041us (2594us total) trans 12884902314 rc 0/0 00000100:00100000:1.0:1779690580.546544:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 975 00000100:00100000:1.0:1779690580.549461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690580.549516:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503769600 00000100:00100000:3.0:1779690580.549526:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503769600 00000100:00100000:3.0:1779690580.549586:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 976 00000100:00100000:3.0:1779690580.549605:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:110788:x1866137503769600:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:3.0:1779690580.549683:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.549699:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.549709:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.549739:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.549752:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 55 pid: 57561 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690580.549766:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357376:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690580.550055:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3084ff8540 going to sleep for 11 seconds 00000100:00100000:3.0:1779690580.553134:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.553220:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503769728 00000100:00100000:0.0:1779690580.553228:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503769728 00010000:00010000:0.0:1779690580.553267:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 56 pid: 57561 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.553315:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3302 00000100:00100000:0.0:1779690580.553325:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+56:2391:x1866137503769728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690580.553338:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690580.553345:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 56 pid: 57561 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.553366:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 56 pid: 57561 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.553408:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442500) 00010000:00010000:0.0:1779690580.553414:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.553425:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.553433:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe00 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee27b expref: 56 pid: 57561 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.553435:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.553456:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357376:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690580.553468:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690580.553479:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.553492:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.553508:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.553523:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:2391:x1866137503769728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 198us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.553531:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3302 00010000:00010000:1.0:1779690580.553980:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.553989:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.553995:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.554000:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81266c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690580.554005:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.554012:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.554020:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442500) 00010000:00010000:1.0:1779690580.554023:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690580.554026:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.554032:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f81266c00/0xb4bb873a1913fe0e lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.554097:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:110788:x1866137503769600:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 4499us (4639us total) trans 12884902315 rc 0/0 00000100:00100000:1.0:1779690580.554105:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 976 00000100:00100000:3.0:1779690580.556584:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.556682:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503769984 00000100:00100000:2.0:1779690580.556689:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503769984 00000100:00100000:2.0:1779690580.556739:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:2.0:1779690580.556748:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:110788:x1866137503769984:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690580.557767:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:110788:x1866137503769984:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 1016us (1186us total) trans 12884902316 rc 0/0 00000100:00100000:2.0:1779690580.557776:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:3.0:1779690580.595231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.595424:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770112 00000100:00100000:0.0:1779690580.595434:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770112 00000100:00100000:0.0:1779690580.595537:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 977 00000100:00100000:0.0:1779690580.595548:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770112:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690580.595709:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770112:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 162us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.595717:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 977 00000100:00100000:3.0:1779690580.599707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.599942:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770240 00000100:00100000:1.0:1779690580.599952:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770240 00000100:00100000:1.0:1779690580.600011:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 978 00000100:00100000:1.0:1779690580.600022:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770240:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1779690580.600192:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690580.600248:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770240:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 228us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.600256:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 978 00000100:00100000:3.0:1779690580.601929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.602312:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770368 00000100:00100000:1.0:1779690580.602322:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770368 00000100:00100000:1.0:1779690580.602374:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 979 00000100:00100000:1.0:1779690580.602384:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770368:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690580.602509:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690580.602588:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770368:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 205us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.602596:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 979 00000100:00100000:3.0:1779690580.605760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.605975:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770496 00000100:00100000:0.0:1779690580.605984:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770496 00000100:00100000:0.0:1779690580.606045:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 980 00000100:00100000:0.0:1779690580.606054:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770496:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690580.606202:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.606342:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770496:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 288us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.606350:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 980 00000100:00100000:3.0:1779690580.615151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.615210:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770624 00000100:00100000:1.0:1779690580.615218:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770624 00000100:00100000:1.0:1779690580.615281:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 981 00000100:00100000:1.0:1779690580.615292:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770624:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690580.615408:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770624:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 118us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.615415:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 981 00000100:00100000:3.0:1779690580.617148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.617217:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770752 00000100:00100000:1.0:1779690580.617223:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770752 00000100:00100000:1.0:1779690580.617266:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 982 00000100:00100000:1.0:1779690580.617289:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770752:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690580.617431:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770752:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 144us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.617439:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 982 00000100:00100000:3.0:1779690580.621493:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.621584:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503770880 00000100:00100000:0.0:1779690580.621593:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503770880 00000100:00100000:0.0:1779690580.621649:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 983 00000100:00100000:0.0:1779690580.621659:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690580.622082:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503770880:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 424us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.622092:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 983 00000100:00100000:3.0:1779690580.626543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.626752:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503771008 00000100:00100000:2.0:1779690580.626760:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503771008 00000100:00100000:2.0:1779690580.626838:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 984 00000100:00100000:2.0:1779690580.626848:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503771008:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690580.627229:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110797:x1866137503771008:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 381us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690580.627238:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 984 00000100:00100000:2.0:1779690580.771423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.771670:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503771264 00000100:00100000:0.0:1779690580.771679:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503771264 00000100:00100000:0.0:1779690580.771741:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 985 00000100:00100000:0.0:1779690580.771752:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+56:110815:x1866137503771264:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690580.771776:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690580.771796:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fe15 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee282 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771902:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771917:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771937:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771951:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771972:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.771978:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772337:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772346:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772353:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690580.772363:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690580.772454:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772461:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772468:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772474:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.772478:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772491:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772513:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690580.772516:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.772521:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772527:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe1c lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772539:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772545:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772551:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772555:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690580.772558:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772563:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772570:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690580.772572:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690580.772580:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772586:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe23 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772638:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fe15 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 59 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772651:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.772658:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690580.772661:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690580.772663:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:0.0:1779690580.772732:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+58:110815:x1866137503771264:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 982us (1317us total) trans 12884902317 rc 0/0 00000100:00100000:0.0:1779690580.772740:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 985 00000100:00100000:3.0:1779690580.775270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.775383:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503771520 00000100:00100000:1.0:1779690580.775391:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503771520 00000100:00100000:1.0:1779690580.775476:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 986 00000100:00100000:1.0:1779690580.775494:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:110815:x1866137503771520:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:1.0:1779690580.775558:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.775583:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.775593:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.775626:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.775639:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 58 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.775652:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492357504:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690580.775897:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f4fef00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690580.778697:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492357504:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690580.778714:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:1.0:1779690580.778757:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.779121:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503771648 00000100:00100000:0.0:1779690580.779128:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503771648 00010000:00010000:0.0:1779690580.779216:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 59 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690580.779272:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3303 00000100:00100000:0.0:1779690580.779282:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:2392:x1866137503771648:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690580.779294:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690580.779300:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 59 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779312:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 59 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779345:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fe2a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee282 expref: 59 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779360:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690580.779364:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779373:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779381:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690580.779411:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690580.779463:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:2392:x1866137503771648:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 183us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.779471:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3303 00010000:00010000:1.0:1779690580.779522:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779531:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779957:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779966:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779973:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779978:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690580.779982:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779988:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.779998:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:1.0:1779690580.780000:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690580.780004:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.780010:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe38 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.780063:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:110815:x1866137503771520:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 4571us (4798us total) trans 12884902318 rc 0/0 00000100:00100000:1.0:1779690580.780076:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 986 00000100:00100000:3.0:1779690580.784552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.785403:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503771904 00000100:00100000:0.0:1779690580.785413:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503771904 00000100:00100000:0.0:1779690580.785512:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:0.0:1779690580.785521:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:110815:x1866137503771904:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1779690580.786330:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:110815:x1866137503771904:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 807us (1783us total) trans 12884902319 rc 0/0 00000100:00100000:0.0:1779690580.786339:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:2.0:1779690580.824905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.825014:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772032 00000100:00100000:0.0:1779690580.825024:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772032 00000100:00100000:0.0:1779690580.825086:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 987 00000100:00100000:0.0:1779690580.825105:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772032:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1779690580.825343:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772032:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 240us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.825351:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 987 00000100:00100000:3.0:1779690580.826845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.826892:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772160 00000100:00100000:0.0:1779690580.826898:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772160 00000100:00100000:0.0:1779690580.826949:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 988 00000100:00100000:0.0:1779690580.826959:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772160:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690580.827087:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.827183:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772160:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 225us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.827190:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 988 00000100:00100000:3.0:1779690580.828760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.828907:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772288 00000100:00100000:1.0:1779690580.828914:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772288 00000100:00100000:1.0:1779690580.828971:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 989 00000100:00100000:1.0:1779690580.828979:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772288:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690580.829098:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690580.829282:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772288:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 304us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.829290:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 989 00000100:00100000:2.0:1779690580.830422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.830518:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772416 00000100:00100000:0.0:1779690580.830524:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772416 00000100:00100000:0.0:1779690580.830563:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 990 00000100:00100000:0.0:1779690580.830572:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772416:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1779690580.830759:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690580.830838:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772416:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 268us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.830846:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 990 00000100:00100000:3.0:1779690580.832437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.832523:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772544 00000100:00100000:1.0:1779690580.832529:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772544 00000100:00100000:1.0:1779690580.832571:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 991 00000100:00100000:1.0:1779690580.832578:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772544:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690580.832670:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772544:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.832676:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 991 00000100:00100000:3.0:1779690580.833879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.834020:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772672 00000100:00100000:1.0:1779690580.834025:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772672 00000100:00100000:1.0:1779690580.834061:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 992 00000100:00100000:1.0:1779690580.834069:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772672:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690580.834232:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772672:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 164us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.834248:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 992 00000100:00100000:3.0:1779690580.837532:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690580.838017:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772800 00000100:00100000:0.0:1779690580.838082:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772800 00000100:00100000:0.0:1779690580.838143:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 993 00000100:00100000:0.0:1779690580.838154:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772800:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1779690580.838341:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772800:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 189us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690580.838354:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 993 00000100:00100000:3.0:1779690580.840961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.841431:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503772928 00000100:00100000:2.0:1779690580.841439:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503772928 00000100:00100000:2.0:1779690580.841544:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 994 00000100:00100000:2.0:1779690580.841554:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772928:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690580.841735:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110824:x1866137503772928:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 182us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690580.841743:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 994 00000100:00100000:3.0:1779690580.983309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.984758:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503773184 00000100:00100000:2.0:1779690580.984771:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503773184 00000100:00100000:2.0:1779690580.985172:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 995 00000100:00100000:2.0:1779690580.985184:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+59:110844:x1866137503773184:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690580.985207:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690580.985241:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe3f lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee289 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985312:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985326:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985338:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985353:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985360:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.985366:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987043:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987057:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987067:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690580.987077:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:2.0:1779690580.987168:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987187:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987194:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987201:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690580.987205:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987360:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987372:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:2.0:1779690580.987375:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690580.987380:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987385:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe46 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987399:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987405:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987411:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987470:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690580.987479:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987485:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987494:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f90226200) 00010000:00010000:2.0:1779690580.987560:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690580.987564:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987570:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe4d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987620:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe3f lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 62 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987634:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 61 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690580.987642:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226100) 00010000:00010000:2.0:1779690580.987644:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690580.987647:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ec00, rc 0) 00000100:00100000:2.0:1779690580.987907:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+61:110844:x1866137503773184:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2724us (4606us total) trans 12884902320 rc 0/0 00000100:00100000:2.0:1779690580.987929:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 995 00000100:00100000:3.0:1779690580.989938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.990027:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503773440 00000100:00100000:1.0:1779690580.990045:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503773440 00000100:00100000:1.0:1779690580.990088:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 996 00000100:00100000:1.0:1779690580.990097:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+61:110844:x1866137503773440:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:1.0:1779690580.990168:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.990183:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 61 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.990191:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.990229:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 61 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.990251:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 61 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.990271:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357632:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690580.990360:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f4fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1779690580.992704:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357632:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690580.992726:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690580.993312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690580.993484:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503773568 00000100:00100000:1.0:1779690580.993490:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503773568 00010000:00010000:1.0:1779690580.993520:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 62 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690580.993580:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3304 00000100:00100000:1.0:1779690580.993589:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+62:2391:x1866137503773568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690580.993604:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690580.993610:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 62 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993622:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 62 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993641:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1913fe54 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee289 expref: 62 pid: 57585 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993656:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226100) 00010000:00010000:1.0:1779690580.993661:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993669:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993677:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690580.993699:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690580.993738:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+61:2391:x1866137503773568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 151us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690580.993743:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3304 00010000:00010000:3.0:1779690580.993851:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.993857:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994304:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994312:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994319:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994325:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690580.994329:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994336:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994352:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226100) 00010000:00010000:3.0:1779690580.994355:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1779690580.994359:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690580.994365:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913fe62 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690580.994423:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+61:110844:x1866137503773440:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 4326us (4506us total) trans 12884902321 rc 0/0 00000100:00100000:3.0:1779690580.994431:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 996 00000100:00100000:3.0:1779690580.995593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690580.998109:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503773824 00000100:00100000:2.0:1779690580.998120:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503773824 00000100:00100000:2.0:1779690580.998185:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:2.0:1779690580.998418:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+61:110844:x1866137503773824:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690580.998967:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+62:110844:x1866137503773824:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 773us (3374us total) trans 12884902322 rc 0/0 00000100:00100000:2.0:1779690580.998982:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:0.0:1779690581.040682:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.040796:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503773952 00000100:00100000:2.0:1779690581.040838:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503773952 00000100:00100000:2.0:1779690581.040905:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 997 00000100:00100000:2.0:1779690581.040925:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503773952:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690581.041101:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503773952:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 187us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.041110:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 997 00000100:00080000:1.0:1779690581.041849:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690581.042628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.042710:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774080 00000100:00100000:2.0:1779690581.042716:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774080 00000100:00100000:2.0:1779690581.042755:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 998 00000100:00100000:2.0:1779690581.042764:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774080:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1779690581.042952:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690581.043007:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774080:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 244us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.043015:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 998 00000100:00100000:3.0:1779690581.044582:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.045912:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774208 00000100:00100000:1.0:1779690581.045931:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774208 00000100:00100000:1.0:1779690581.045987:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 999 00000100:00100000:1.0:1779690581.046005:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774208:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1779690581.046149:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1779690581.046230:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774208:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 227us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.046238:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 999 00000100:00100000:0.0:1779690581.048232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.048330:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774336 00000100:00100000:2.0:1779690581.048337:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774336 00000100:00100000:2.0:1779690581.048385:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1000 00000100:00100000:2.0:1779690581.048395:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774336:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690581.048520:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690581.048672:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774336:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 278us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.048690:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1000 00000100:00100000:3.0:1779690581.050327:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.050382:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774464 00000100:00100000:1.0:1779690581.050388:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774464 00000100:00100000:1.0:1779690581.050479:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1001 00000100:00100000:1.0:1779690581.050489:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774464:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1779690581.050577:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774464:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.050585:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1001 00000100:00100000:3.0:1779690581.051958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690581.052024:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774592 00000100:00100000:0.0:1779690581.052029:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774592 00000100:00100000:0.0:1779690581.052068:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1002 00000100:00100000:0.0:1779690581.052075:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774592:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1779690581.052198:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774592:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690581.052212:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1002 00000100:00100000:0.0:1779690581.054721:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.054836:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774720 00000100:00100000:2.0:1779690581.054843:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774720 00000100:00100000:2.0:1779690581.054900:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1003 00000100:00100000:2.0:1779690581.054909:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774720:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690581.055138:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774720:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 229us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.055145:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1003 00000100:00100000:3.0:1779690581.057041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.057341:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503774848 00000100:00100000:1.0:1779690581.057348:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503774848 00000100:00100000:1.0:1779690581.057399:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1004 00000100:00100000:1.0:1779690581.057406:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774848:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1779690581.057550:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110853:x1866137503774848:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 144us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.057558:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1004 00000100:00100000:0.0:1779690581.259368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.259600:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503775104 00000100:00100000:2.0:1779690581.259609:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503775104 00000100:00100000:2.0:1779690581.259678:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1005 00000100:00100000:2.0:1779690581.259689:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+62:110875:x1866137503775104:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690581.259712:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690581.259731:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe69 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee290 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259797:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259839:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259851:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259865:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259886:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.259893:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260231:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260240:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260247:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690581.260255:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:2.0:1779690581.260333:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260341:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260347:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260352:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690581.260356:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.260364:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1779690581.260460:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690581.261185:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:2.0:1779690581.261188:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690581.261193:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261200:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fe70 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261213:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261219:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261224:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261229:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690581.261232:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261237:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261243:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f90226200) 00010000:00010000:2.0:1779690581.261246:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690581.261248:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261253:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913fe77 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261309:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe69 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261323:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.261330:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226c00) 00010000:00010000:2.0:1779690581.261332:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690581.261334:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690581.262540:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+64:110875:x1866137503775104:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2850us (3177us total) trans 12884902323 rc 0/0 00000100:00100000:2.0:1779690581.262550:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1005 00000100:00100000:0.0:1779690581.267552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.268534:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503775360 00000100:00100000:2.0:1779690581.268544:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503775360 00000100:00100000:2.0:1779690581.268651:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1006 00000100:00100000:2.0:1779690581.268662:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:110875:x1866137503775360:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:2.0:1779690581.268724:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.268739:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.268748:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.268776:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.268820:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 64 pid: 64445 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.268835:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492357760:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690581.268929:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8a8d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1779690581.270796:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492357760:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690581.270834:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690581.271546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.271635:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503775488 00000100:00100000:2.0:1779690581.271641:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503775488 00010000:00010000:2.0:1779690581.271670:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 65 pid: 64445 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.271734:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3305 00000100:00100000:2.0:1779690581.271744:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:2391:x1866137503775488:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690581.271756:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690581.271762:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 65 pid: 64445 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271773:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 65 pid: 64445 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271792:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fe7e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee290 expref: 65 pid: 64445 timeout: 3408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271841:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226c00) 00010000:00010000:2.0:1779690581.271845:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271853:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271860:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.271886:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690581.271942:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:2391:x1866137503775488:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.271948:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3305 00010000:00010000:3.0:1779690581.272094:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272102:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272522:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272530:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272536:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272549:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690581.272553:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272560:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272569:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226c00) 00010000:00010000:3.0:1779690581.272572:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1779690581.272575:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.272581:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fe8c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690581.272643:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:110875:x1866137503775360:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 3983us (5099us total) trans 12884902324 rc 0/0 00000100:00100000:3.0:1779690581.272652:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1006 00000100:00100000:0.0:1779690581.280671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.280997:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503775744 00000100:00100000:3.0:1779690581.281006:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503775744 00000100:00100000:3.0:1779690581.281068:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:3.0:1779690581.281077:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+64:110875:x1866137503775744:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1779690581.281747:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:110875:x1866137503775744:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 669us (1083us total) trans 12884902325 rc 0/0 00000100:00100000:3.0:1779690581.281755:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:1.0:1779690581.335446:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.335547:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503775872 00000100:00100000:2.0:1779690581.335557:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503775872 00000100:00100000:2.0:1779690581.335619:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1007 00000100:00100000:2.0:1779690581.335628:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503775872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690581.335795:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503775872:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.335828:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1007 00000100:00100000:1.0:1779690581.338350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.338444:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776000 00000100:00100000:2.0:1779690581.338452:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776000 00000100:00100000:2.0:1779690581.338502:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1008 00000100:00100000:2.0:1779690581.338511:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1779690581.338773:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690581.338908:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776000:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 397us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.338927:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1008 00000100:00100000:0.0:1779690581.342072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.342189:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776128 00000100:00100000:3.0:1779690581.342199:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776128 00000100:00100000:3.0:1779690581.342303:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1009 00000100:00100000:3.0:1779690581.342328:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690581.342482:0:57560:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690581.342579:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776128:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 253us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.342586:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1009 00000100:00100000:1.0:1779690581.345223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.345312:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776256 00000100:00100000:3.0:1779690581.345321:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776256 00000100:00100000:3.0:1779690581.345517:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1010 00000100:00100000:3.0:1779690581.345529:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690581.345749:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690581.345852:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776256:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 325us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.345860:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1010 00000100:00100000:1.0:1779690581.348717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.348957:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776384 00000100:00100000:2.0:1779690581.348966:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776384 00000100:00100000:2.0:1779690581.349029:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1011 00000100:00100000:2.0:1779690581.349038:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776384:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690581.349146:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776384:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 108us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.349154:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1011 00000100:00100000:0.0:1779690581.350879:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.350953:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776512 00000100:00100000:3.0:1779690581.350960:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776512 00000100:00100000:3.0:1779690581.351005:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1012 00000100:00100000:3.0:1779690581.351013:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776512:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690581.351160:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776512:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 147us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.351167:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1012 00000100:00100000:1.0:1779690581.353895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.354078:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776640 00000100:00100000:2.0:1779690581.354086:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776640 00000100:00100000:2.0:1779690581.354129:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1013 00000100:00100000:2.0:1779690581.354137:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776640:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690581.354315:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776640:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 178us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.354323:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1013 00000100:00100000:0.0:1779690581.357906:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.358106:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776768 00000100:00100000:2.0:1779690581.358115:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776768 00000100:00100000:2.0:1779690581.358170:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1014 00000100:00100000:2.0:1779690581.358182:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690581.358377:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110884:x1866137503776768:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 189us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.358385:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1014 00000100:00100000:3.0:1779690581.441146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.441548:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503776896 00000100:00100000:1.0:1779690581.441559:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503776896 00000100:00100000:1.0:1779690581.441618:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1015 00000100:00100000:1.0:1779690581.441629:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2392:x1866137503776896:12345-192.168.203.5@tcp:17:kworker.0 00000100:00100000:1.0:1779690581.441734:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2392:x1866137503776896:12345-192.168.203.5@tcp:17:kworker.0 Request processed in 107us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.441742:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1015 00010000:00010000:1.0:1779690581.449007:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690581.566317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690581.566397:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503777152 00000100:00100000:0.0:1779690581.566406:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503777152 00000100:00100000:0.0:1779690581.566514:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1016 00000100:00100000:0.0:1779690581.566526:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+65:110908:x1866137503777152:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690581.566545:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690581.566564:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe93 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee297 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566650:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566664:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566676:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566690:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566696:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.566702:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567091:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567100:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567107:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690581.567116:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:0.0:1779690581.567208:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567225:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567231:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567236:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690581.567240:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567247:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567257:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:0.0:1779690581.567259:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690581.567263:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567268:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913fe9a lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567279:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567284:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567289:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567294:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ea00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690581.567302:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567308:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567315:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690581.567317:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690581.567320:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567324:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913fea1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567365:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913fe93 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 68 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567377:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690581.567384:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690581.567386:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690581.567388:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e200, rc 0) 00000100:00100000:0.0:1779690581.567551:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+67:110908:x1866137503777152:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1027us (1243us total) trans 12884902326 rc 0/0 00000100:00100000:0.0:1779690581.567559:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1016 00000100:00100000:0.0:1779690581.572165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.572640:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503777408 00000100:00100000:3.0:1779690581.572649:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503777408 00000100:00100000:1.0:1779690581.572898:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1017 00000100:00100000:1.0:1779690581.572921:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+67:110908:x1866137503777408:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:1.0:1779690581.572987:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.573004:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.573014:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.573047:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.573060:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 67 pid: 64445 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690581.573093:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357888:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690581.573183:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f4fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1779690581.575533:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492357888:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690581.575560:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690581.576585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.576676:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503777536 00000100:00100000:2.0:1779690581.576694:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503777536 00010000:00010000:2.0:1779690581.576727:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 68 pid: 64445 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.576766:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3306 00000100:00100000:2.0:1779690581.576775:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503777536:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690581.576788:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690581.576794:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 68 pid: 64445 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576837:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 68 pid: 64445 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576858:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e200/0xb4bb873a1913fea8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee297 expref: 68 pid: 64445 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576873:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:2.0:1779690581.576878:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576887:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576894:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.576932:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690581.576985:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+67:2391:x1866137503777536:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 210us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.577002:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3306 00010000:00010000:1.0:1779690581.577018:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577035:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577565:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577575:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577583:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577589:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690581.577594:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577603:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577618:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:1.0:1779690581.577625:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1779690581.577630:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.577634:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feb6 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690581.577723:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+67:110908:x1866137503777408:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 4813us (5564us total) trans 12884902327 rc 0/0 00000100:00100000:1.0:1779690581.577730:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1017 00000100:00100000:0.0:1779690581.579986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.580060:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503777792 00000100:00100000:2.0:1779690581.580069:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503777792 00000100:00100000:2.0:1779690581.580123:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:2.0:1779690581.580133:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+67:110908:x1866137503777792:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690581.580631:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:110908:x1866137503777792:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 498us (652us total) trans 12884902328 rc 0/0 00000100:00100000:2.0:1779690581.580639:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:3.0:1779690581.595929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.596037:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778048 00000100:00100000:2.0:1779690581.596059:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778048 00000100:00100000:2.0:1779690581.596111:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1018 00000100:00100000:2.0:1779690581.596121:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:110909:x1866137503778048:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690581.596149:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690581.596169:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913febd lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee29e expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596242:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596262:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596273:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596287:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596305:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.596309:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597100:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597111:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597118:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690581.597128:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:2.0:1779690581.597211:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597220:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597227:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597233:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690581.597237:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597244:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597266:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:2.0:1779690581.597269:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690581.597274:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597280:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913fec4 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597293:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597299:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597304:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597309:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690581.597311:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597317:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597324:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f90226200) 00010000:00010000:2.0:1779690581.597326:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690581.597328:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597333:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913fecb lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597384:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1913febd lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 71 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597396:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 70 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.597403:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:2.0:1779690581.597405:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690581.597408:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690581.597695:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+70:110909:x1866137503778048:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1575us (1786us total) trans 12884902329 rc 0/0 00000100:00100000:2.0:1779690581.597703:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1018 00000100:00100000:0.0:1779690581.600014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.600105:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778304 00000100:00100000:2.0:1779690581.600114:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778304 00000100:00100000:2.0:1779690581.600167:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1019 00000100:00100000:2.0:1779690581.600176:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+70:110909:x1866137503778304:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:2.0:1779690581.600241:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.600258:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 70 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.600267:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.600304:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 70 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.600330:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 70 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.600344:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492358016:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690581.600424:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8a8d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690581.601938:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492358016:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690581.601958:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690581.602177:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.602523:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778432 00000100:00100000:1.0:1779690581.602530:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778432 00010000:00010000:1.0:1779690581.602560:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 71 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690581.602596:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3307 00000100:00100000:1.0:1779690581.602605:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+71:2391:x1866137503778432:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690581.602617:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690581.602623:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 71 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.602634:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 71 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.602655:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1913fed2 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee29e expref: 71 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.602669:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690581.602683:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.602692:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.602702:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.603577:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690581.603622:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+70:2391:x1866137503778432:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1016us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.603632:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3307 00010000:00010000:2.0:1779690581.608189:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608206:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608625:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608633:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608639:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608644:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690581.608648:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608665:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608680:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:2.0:1779690581.608683:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690581.608688:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.608694:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913fee0 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.608798:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+70:110909:x1866137503778304:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 8620us (8789us total) trans 12884902330 rc 0/0 00000100:00100000:2.0:1779690581.608839:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1019 00000100:00100000:3.0:1779690581.610797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.610926:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778688 00000100:00100000:1.0:1779690581.610935:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778688 00000100:00100000:1.0:1779690581.610988:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:1.0:1779690581.610998:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+70:110909:x1866137503778688:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1779690581.611471:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+71:110909:x1866137503778688:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 473us (678us total) trans 12884902331 rc 0/0 00000100:00100000:1.0:1779690581.611479:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:1.0:1779690581.650192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.650300:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778816 00000100:00100000:3.0:1779690581.650310:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778816 00000100:00100000:3.0:1779690581.650489:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1020 00000100:00100000:3.0:1779690581.650501:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503778816:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690581.650677:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503778816:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 178us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.651229:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1020 00000100:00100000:1.0:1779690581.652623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690581.652668:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503778944 00000100:00100000:0.0:1779690581.652674:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503778944 00000100:00100000:0.0:1779690581.652720:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1021 00000100:00100000:0.0:1779690581.652729:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503778944:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1779690581.652925:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1779690581.652983:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503778944:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 256us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690581.652991:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1021 00000100:00100000:0.0:1779690581.654762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.654848:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779072 00000100:00100000:2.0:1779690581.654855:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779072 00000100:00100000:2.0:1779690581.654974:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1022 00000100:00100000:2.0:1779690581.654984:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779072:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1779690581.655114:0:64445:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690581.655226:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779072:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 243us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.655235:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1022 00000100:00100000:1.0:1779690581.662328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.662632:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779200 00000100:00100000:3.0:1779690581.662642:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779200 00000100:00100000:3.0:1779690581.662754:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1023 00000100:00100000:3.0:1779690581.662766:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779200:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690581.662945:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690581.663027:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779200:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 263us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.663034:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1023 00000100:00100000:0.0:1779690581.665504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.665744:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779328 00000100:00100000:2.0:1779690581.665752:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779328 00000100:00100000:2.0:1779690581.665803:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1024 00000100:00100000:2.0:1779690581.665843:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779328:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690581.665944:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779328:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 103us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.665963:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1024 00000100:00100000:0.0:1779690581.667761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.667922:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779456 00000100:00100000:1.0:1779690581.667929:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779456 00000100:00100000:1.0:1779690581.667969:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1025 00000100:00100000:1.0:1779690581.667979:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779456:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1779690581.668161:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779456:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 184us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690581.668175:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1025 00000100:00100000:1.0:1779690581.670888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.670961:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779584 00000100:00100000:3.0:1779690581.670969:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779584 00000100:00100000:3.0:1779690581.671063:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1026 00000100:00100000:3.0:1779690581.671072:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779584:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690581.671246:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779584:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 174us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.671254:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1026 00000100:00100000:0.0:1779690581.673851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.673935:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779712 00000100:00100000:2.0:1779690581.673942:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779712 00000100:00100000:2.0:1779690581.673986:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1027 00000100:00100000:2.0:1779690581.673994:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779712:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1779690581.674145:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:110918:x1866137503779712:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 151us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.674152:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1027 00000100:00100000:0.0:1779690581.854544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690581.854658:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503779968 00000100:00100000:1.0:1779690581.854667:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503779968 00000100:00100000:1.0:1779690581.854727:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1028 00000100:00100000:1.0:1779690581.854737:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+71:110946:x1866137503779968:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690581.854760:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690581.854784:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fee7 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2a5 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854895:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854920:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854931:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854944:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854951:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.854957:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.855342:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.855356:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.855375:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690581.855386:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x27:0x0]: returning size 0 00010000:00010000:1.0:1779690581.856634:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856647:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856653:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856659:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690581.856663:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856671:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856683:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x0 (ffff9e2f8be8c100) 00010000:00010000:1.0:1779690581.856686:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690581.856689:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856695:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913feee lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856722:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856728:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856733:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856737:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690581.856740:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856745:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856768:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x26:0x0].0x7bb10507 (ffff9e2f90442500) 00010000:00010000:1.0:1779690581.856770:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690581.856780:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856786:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913fef5 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x26:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856867:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913fee7 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 74 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856881:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690581.856900:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442800) 00010000:00010000:1.0:1779690581.856903:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690581.856906:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86000, rc 0) 00000100:00100000:1.0:1779690581.856982:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+73:110946:x1866137503779968:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2246us (2447us total) trans 12884902332 rc 0/0 00000100:00100000:1.0:1779690581.856990:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1028 00000100:00100000:1.0:1779690581.859522:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.859965:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780224 00000100:00100000:2.0:1779690581.859975:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780224 00000100:00100000:2.0:1779690581.860035:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1029 00000100:00100000:2.0:1779690581.860045:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+73:110946:x1866137503780224:12345-192.168.203.5@tcp:55:lfs.0 00010000:00010000:2.0:1779690581.860105:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.860121:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.860129:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.860161:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.860186:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 73 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.860220:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492358144:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690581.860304:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8a8d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690581.861953:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492358144:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690581.861974:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690581.862324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.862369:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780352 00000100:00100000:2.0:1779690581.862374:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780352 00010000:00010000:2.0:1779690581.862395:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 74 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690581.862450:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3308 00000100:00100000:2.0:1779690581.862456:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:2392:x1866137503780352:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690581.862464:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690581.862468:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 74 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862475:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 74 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862490:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913fefc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2a5 expref: 74 pid: 57561 timeout: 3409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862500:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442800) 00010000:00010000:2.0:1779690581.862503:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862516:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862521:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690581.862540:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690581.862574:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+73:2392:x1866137503780352:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.862579:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3308 00010000:00010000:3.0:1779690581.862649:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.862656:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863358:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863368:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863376:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863381:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690581.863385:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863392:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863403:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x27:0x0].0x0 (ffff9e2f90442800) 00010000:00010000:3.0:1779690581.863406:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1779690581.863410:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690581.863416:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff0a lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x27:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690581.863471:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+73:110946:x1866137503780224:12345-192.168.203.5@tcp:55:lfs.0 Request processed in 3427us (3954us total) trans 12884902333 rc 0/0 00000100:00100000:3.0:1779690581.863480:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1029 00000100:00100000:1.0:1779690581.865940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.866009:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780608 00000100:00100000:2.0:1779690581.866026:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780608 00000100:00100000:2.0:1779690581.866081:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:2.0:1779690581.866095:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+73:110946:x1866137503780608:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690581.866537:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:110946:x1866137503780608:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 442us (602us total) trans 12884902334 rc 0/0 00000100:00100000:2.0:1779690581.866546:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:0.0:1779690581.902478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.902549:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780736 00000100:00100000:3.0:1779690581.902558:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780736 00000100:00100000:3.0:1779690581.902616:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1030 00000100:00100000:3.0:1779690581.902640:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780736:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1779690581.902827:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780736:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 164us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.902835:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1030 00000100:00100000:1.0:1779690581.910506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.910669:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780864 00000100:00100000:2.0:1779690581.910679:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780864 00000100:00100000:2.0:1779690581.910873:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1031 00000100:00100000:2.0:1779690581.910895:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780864:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1779690581.911058:0:57561:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1779690581.911132:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780864:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 250us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.911140:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1031 00000100:00100000:0.0:1779690581.914733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.914843:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503780992 00000100:00100000:3.0:1779690581.914852:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503780992 00000100:00100000:3.0:1779690581.914921:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1032 00000100:00100000:3.0:1779690581.914932:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780992:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690581.915170:0:57585:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690581.915301:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503780992:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 370us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.915310:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1032 00000100:00100000:1.0:1779690581.921638:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.923274:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781120 00000100:00100000:3.0:1779690581.923284:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781120 00000100:00100000:3.0:1779690581.923387:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1033 00000100:00100000:3.0:1779690581.923397:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781120:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1779690581.923546:0:57559:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1779690581.923642:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781120:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 246us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.923650:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1033 00000100:00100000:1.0:1779690581.928151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690581.928382:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781248 00000100:00100000:2.0:1779690581.928402:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781248 00000100:00100000:2.0:1779690581.928464:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1034 00000100:00100000:2.0:1779690581.928474:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781248:12345-192.168.203.5@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1779690581.928585:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781248:12345-192.168.203.5@tcp:501:chlg_load_threa.0 Request processed in 112us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.928592:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1034 00000100:00100000:1.0:1779690581.930792:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.930984:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781376 00000100:00100000:3.0:1779690581.930991:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781376 00000100:00100000:3.0:1779690581.931114:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1035 00000100:00100000:3.0:1779690581.931123:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781376:12345-192.168.203.5@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1779690581.931260:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781376:12345-192.168.203.5@tcp:503:chlg_load_threa.0 Request processed in 138us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.931273:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1035 00000100:00100000:1.0:1779690581.938292:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.938892:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781504 00000100:00100000:3.0:1779690581.938899:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781504 00000100:00100000:3.0:1779690581.938965:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1036 00000100:00100000:3.0:1779690581.938975:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781504:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690581.939407:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781504:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 434us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.939414:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1036 00000100:00100000:1.0:1779690581.943215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690581.944708:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781632 00000100:00100000:3.0:1779690581.944717:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781632 00000100:00100000:3.0:1779690581.944766:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1037 00000100:00100000:3.0:1779690581.944774:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781632:12345-192.168.203.5@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1779690581.945331:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:110955:x1866137503781632:12345-192.168.203.5@tcp:502:chlg_load_threa.0 Request processed in 556us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.945340:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1037 00000100:00100000:3.0:1779690581.961193:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690581.961218:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492358272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690581.961239:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690581.961252:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492358400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690581.961304:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690581.961340:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358400 00000100:00100000:3.0:1779690581.961348:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358400 00000100:00100000:0.0:1779690581.962136:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690581.962300:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358272 00000100:00100000:2.0:1779690581.962305:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358272 00000100:00100000:2.0:1779690581.962391:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1779690581.962400:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492358272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690581.962429:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742719488 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690581.962469:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492358272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.962476:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1779690581.962503:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492358528:0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.962532:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690581.962540:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492358912:0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.962569:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358528 00000100:00100000:2.0:1779690581.962573:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358528 00000100:00100000:1.0:1779690581.962581:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690581.962601:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1779690581.962608:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690581.962626:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492358656:0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.962645:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492358528:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.962651:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1779690581.962656:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690581.962691:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968351 gen 2 00000004:00080000:1.0:1779690581.962699:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f8d2c0a80, transno 4294968351 00000100:00100000:2.0:1779690581.962708:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492358528:0@lo:400:kworker.0 00000100:00100000:1.0:1779690581.962718:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492358272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690581.962736:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690581.962743:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492358784:0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.962748:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358912 00000100:00100000:2.0:1779690581.962751:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358912 00000100:00100000:2.0:1779690581.962781:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358656 00000100:00100000:1.0:1779690581.962782:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690581.962785:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358656 00000100:00100000:1.0:1779690581.962824:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492358784 00000100:00100000:1.0:1779690581.962828:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492358784 00000100:00080000:0.0:1779690581.963666:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690581.963672:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690581.963674:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690581.963697:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1779690581.963705:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492358400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690581.963725:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 621346816 pending 0 free 3761242112 avail 3759144960 00000100:00100000:3.0:1779690581.963758:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492358400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690581.963771:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1779690581.963798:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968447 gen 2 00000004:00080000:3.0:1779690581.963802:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f81a20000, transno 4294968447 00000100:00100000:3.0:1779690581.963833:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492358400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690581.964054:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1779690581.964063:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492358912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690581.964108:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492358912:12345-0@lo:400:kworker.0 Request processed in 47us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690581.964115:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1779690581.964146:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492358912:0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.964522:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1779690581.964531:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.964581:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492358656:12345-0@lo:400:kworker.0 Request processed in 51us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.964588:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1779690581.964601:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1779690581.964607:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690581.964635:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492358784:12345-0@lo:400:kworker.0 Request processed in 29us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690581.964641:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1779690581.965269:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492358784:0@lo:400:kworker.0 00000100:00100000:0.0:1779690581.965299:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492358656:0@lo:400:kworker.0 00010000:00010000:2.0:1779690582.474143:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690583.498689:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690583.949866:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690583.949874:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690583.950258:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 41 count 10 00000040:00080000:0.0:1779690583.950266:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690584.512702:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.512744:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.512824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.512844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.512862:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.512878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690584.512935:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781760 00000100:00100000:3.0:1779690584.512944:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781760 00000100:00100000:3.0:1779690584.512987:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:3.0:1779690584.512995:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503781760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690584.513058:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503781760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 63us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690584.513065:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:3.0:1779690584.513097:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782016 00000100:00100000:3.0:1779690584.513101:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782016 00000100:00100000:3.0:1779690584.513130:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2980 00000100:00100000:3.0:1779690584.513136:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503782016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690584.513163:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503782016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690584.513169:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2980 00000100:00100000:3.0:1779690584.513179:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782144 00000100:00100000:3.0:1779690584.513182:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782144 00000100:00100000:3.0:1779690584.513213:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782400 00000100:00100000:3.0:1779690584.513217:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782400 00000100:00100000:3.0:1779690584.513238:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2981 00000100:00100000:3.0:1779690584.513244:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+12:2390:x1866137503782144:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690584.513276:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+12:2390:x1866137503782144:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690584.513283:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2981 00000100:00100000:3.0:1779690584.513295:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2982 00000100:00100000:3.0:1779690584.513301:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503782400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690584.513322:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503782400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690584.513328:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2982 00000100:00080000:3.0:1779690584.513445:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690584.513449:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690584.515679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690584.516869:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782528 00000100:00100000:1.0:1779690584.516878:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782528 00000100:00080000:3.0:1779690584.516924:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690584.516947:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2983 00000100:00100000:1.0:1779690584.516957:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503782528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690584.517015:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503782528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690584.517023:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2983 00000100:00100000:0.0:1779690584.519150:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503781888 00000100:00100000:0.0:1779690584.519159:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503781888 00000100:00100000:0.0:1779690584.520388:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782272 00000100:00100000:0.0:1779690584.520395:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782272 00000100:00100000:2.0:1779690584.521200:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 292 00000100:00100000:2.0:1779690584.521214:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:2390:x1866137503781888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690584.521295:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:2390:x1866137503781888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 85us (8550us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690584.521303:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 292 00010000:00010000:2.0:1779690584.521876:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1779690584.522068:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690584.522224:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:0.0:1779690584.522234:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:2389:x1866137503782272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690584.522279:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:2389:x1866137503782272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (9399us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690584.522284:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 293 00010000:00010000:3.0:1779690585.548904:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690585.593661:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902326 is committed 00000001:00080000:1.0:1779690585.593688:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902332 is committed 00000001:00080000:1.0:1779690585.593709:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902334 is committed 00000040:00080000:3.0:1779690585.722117:0:72691:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690585.722125:0:72691:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690585.722250:0:72691:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 14 count 2 00000040:00080000:3.0:1779690585.722257:0:72691:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1779690585.768357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690585.768392:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782656 00000100:00100000:1.0:1779690585.768400:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782656 00000100:00100000:1.0:1779690585.768829:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1038 00000100:00100000:1.0:1779690585.768841:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:111418:x1866137503782656:12345-192.168.203.5@tcp:46:lfs.0 00000004:00000080:1.0:1779690585.768891:0:57585:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9e30b396d4b8 uarg=0000000000000000 00000004:00000080:1.0:1779690585.769180:0:57585:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9e30b396d4b8 00000004:00000080:1.0:1779690585.769194:0:57585:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=13, endrec=0 00000040:00080000:1.0:1779690585.769293:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690585.769298:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690585.769345:0:57585:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl13 endrec = 83 00000040:00080000:1.0:1779690585.770138:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 14 count 2 00000040:00080000:1.0:1779690585.770147:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690585.770152:0:57585:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl13 entries up to 18446744073709551615 00000040:00080000:1.0:1779690585.770198:0:57585:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690585.770201:0:57585:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690585.775413:0:57585:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 83 count 1 00000040:00080000:1.0:1779690585.775426:0:57585:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1779690585.775620:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+54:111418:x1866137503782656:12345-192.168.203.5@tcp:46:lfs.0 Request processed in 6776us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690585.775630:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1038 00000020:00000080:1.0:1779690586.293455:0:72739:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffea15f6690 00000004:00000080:1.0:1779690586.293470:0:72739:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9e2f81971800 uarg=0000000000000000 00000004:00000080:1.0:1779690586.293509:0:72739:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9e2f81971800 00000004:00000080:1.0:1779690586.293515:0:72739:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=13, endrec=0 00000040:00080000:1.0:1779690586.293610:0:72739:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690586.293614:0:72739:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1779690586.293644:0:72739:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl13 endrec = 83 00000040:00080000:1.0:1779690586.293703:0:72739:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 14 count 2 00000040:00080000:1.0:1779690586.293710:0:72739:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690586.293741:0:72739:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl13 entries up to 18446744073709551615 00000040:00080000:1.0:1779690586.293786:0:72739:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690586.293789:0:72739:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690586.294523:0:72739:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690586.294531:0:72739:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:1.0:1779690586.294553:0:72739:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=13 00000040:00080000:1.0:1779690586.294610:0:72739:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690586.294613:0:72739:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690586.294910:0:72739:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 13 count 1 00000040:00080000:1.0:1779690586.294916:0:72739:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1779690586.294933:0:72739:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1779690586.294935:0:72739:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1779690586.294937:0:72739:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl13 record=18446744073709551615 00000040:00080000:1.0:1779690586.294975:0:72739:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690586.294978:0:72739:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x19:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1779690586.295547:0:72739:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x19:0x0] index 64768 count 1 00000040:00080000:1.0:1779690586.295554:0:72739:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:1.0:1779690586.295616:0:72739:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1779690586.295619:0:72739:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1779690586.296205:0:72739:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:1.0:1779690586.296213:0:72739:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1779690586.569730:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690586.821723:0:72787:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1779690586.821734:0:72787:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x17:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1779690586.823108:0:72787:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x17:0x0] index 64768 count 1 00000040:00080000:3.0:1779690586.823124:0:72787:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1779690587.081506:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492359040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690587.081598:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690587.081706:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359040 00000100:00100000:0.0:1779690587.081717:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359040 00000100:00100000:0.0:1779690587.081801:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1779690587.081849:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492359040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690587.081907:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 621346816 pending 0 free 3761242112 avail 3759144960 00000100:00080000:2.0:1779690587.081994:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690587.086246:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492359040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4384us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690587.086266:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1779690587.086341:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492359168:0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.086425:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690587.086654:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492359552:0@lo:400:kworker.0 00000100:00100000:3.0:1779690587.086697:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690587.087466:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492359296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690587.087577:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690587.087623:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359296 00000100:00100000:0.0:1779690587.087632:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359296 00000100:00100000:0.0:1779690587.087692:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1779690587.087703:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492359296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690587.087751:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 742719488 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690587.087799:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492359296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690587.087834:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00080000:0.0:1779690587.087875:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690587.087899:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359552 00000100:00100000:0.0:1779690587.087903:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359552 00000100:00100000:0.0:1779690587.087937:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1779690587.087943:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.087978:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492359552:12345-0@lo:400:kworker.0 Request processed in 36us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690587.087984:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1779690587.088003:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690587.088087:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492359424:0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.088115:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690587.091149:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359424 00000100:00100000:0.0:1779690587.091171:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359424 00000100:00100000:0.0:1779690587.091267:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1779690587.091280:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492359424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.091403:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492359424:12345-0@lo:400:kworker.0 Request processed in 125us (3285us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690587.091411:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1779690587.091458:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690587.092851:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359168 00000100:00100000:1.0:1779690587.092877:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359168 00000100:00100000:1.0:1779690587.093058:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1779690587.093071:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690587.093443:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492359552:0@lo:400:kworker.0 00000100:00100000:3.0:1779690587.093475:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492359040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690587.093868:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492359296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690587.094036:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492359168:12345-0@lo:400:kworker.0 Request processed in 966us (7607us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690587.094048:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1779690587.094328:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492359168:0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.094353:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492359680:0@lo:400:kworker.0 00000100:00100000:0.0:1779690587.094405:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690587.094562:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492359424:0@lo:400:kworker.0 00000100:00100000:2.0:1779690587.094638:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492359680 00000100:00100000:2.0:1779690587.094646:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492359680 00000100:00100000:2.0:1779690587.094727:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1779690587.094737:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492359680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690587.094892:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492359680:12345-0@lo:400:kworker.0 Request processed in 157us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690587.094899:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1779690587.095051:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492359680:0@lo:400:kworker.0 00010000:00010000:1.0:1779690587.593136:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1779690587.881991:0:72835:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 02:29:46 (1779690586) 00000100:00100000:1.0:1779690588.095458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690588.095772:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503782912 00000100:00100000:0.0:1779690588.095782:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503782912 00000100:00100000:0.0:1779690588.095911:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1039 00000100:00100000:0.0:1779690588.095923:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:111612:x1866137503782912:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690588.095944:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690588.095962:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ff11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2ac expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096032:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096045:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096056:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096070:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096076:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096082:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096485:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ff26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096500:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096508:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690588.096517:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1779690588.096868:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.096876:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690588.097056:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690588.097085:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097093:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690588.097097:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097105:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097116:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:0.0:1779690588.097119:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.097124:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097130:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097143:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097155:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097161:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097166:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690588.097169:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097175:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097183:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690588.097185:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.097188:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097194:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097583:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f400/0xb4bb873a1913ff11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ac expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097598:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ff26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ac expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.097604:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690588.097607:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.097616:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34ea00, rc 0) 00000100:00100000:0.0:1779690588.098028:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+56:111612:x1866137503782912:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2107us (2577us total) trans 12884902335 rc 0/0 00000100:00100000:0.0:1779690588.098036:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1039 00000100:00100000:2.0:1779690588.104929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.105028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.105195:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783040 00000100:00100000:2.0:1779690588.105204:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783040 00000100:00100000:2.0:1779690588.105264:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18682 00000100:00100000:2.0:1779690588.105274:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+56:2390:x1866137503783040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690588.105289:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690588.105317:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ea00/0xb4bb873a1913ff26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ac expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.105335:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690588.105340:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690588.105388:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+55:2390:x1866137503783040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690588.105395:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18682 00000100:00100000:0.0:1779690588.105535:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783168 00000100:00100000:0.0:1779690588.105540:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783168 00000100:00100000:0.0:1779690588.105581:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1040 00000100:00100000:0.0:1779690588.105588:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:111612:x1866137503783168:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1779690588.105663:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:111612:x1866137503783168:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 75us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690588.105669:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1040 00000100:00100000:2.0:1779690588.121978:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690588.122061:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783296 00000100:00100000:1.0:1779690588.122083:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783296 00000100:00100000:1.0:1779690588.122169:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1041 00000100:00100000:1.0:1779690588.122179:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+53:111613:x1866137503783296:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690588.122199:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690588.122218:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2b3 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122281:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122295:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122307:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122322:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122329:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122335:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122589:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122597:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122603:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122615:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.122619:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122627:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122640:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:1.0:1779690588.122643:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.122649:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122655:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122672:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122677:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122683:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122688:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.122691:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122697:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122715:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (ffff9e2f90442b00) 00010000:00010000:1.0:1779690588.122718:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.122721:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122727:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122760:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2b3 expref: 54 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122770:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:1.0:1779690588.122772:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.122776:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2b3 expref: 54 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.122785:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87c00, rc 0) 00000100:00100000:1.0:1779690588.122903:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+53:111613:x1866137503783296:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 726us (933us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690588.122911:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1041 00000100:00080000:2.0:1779690588.122981:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690588.127429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.127577:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783552 00000100:00100000:2.0:1779690588.127586:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783552 00000100:00100000:2.0:1779690588.127640:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1042 00000100:00100000:2.0:1779690588.127649:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+53:111613:x1866137503783552:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:2.0:1779690588.127701:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690588.127726:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ee00/0xb4bb873a1913fd20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee251 expref: 53 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.127756:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:2.0:1779690588.127761:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690588.128210:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.128224:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.128232:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.128260:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 54 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.128271:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 54 pid: 57561 timeout: 3415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690588.128283:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492359808:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690588.128403:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82f91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1779690588.134934:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492359808:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690588.134962:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690588.135980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690588.136058:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783680 00000100:00100000:0.0:1779690588.136065:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783680 00010000:00010000:0.0:1779690588.136097:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 55 pid: 57561 timeout: 3415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690588.136130:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3309 00000100:00100000:0.0:1779690588.136141:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+55:2392:x1866137503783680:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690588.136155:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690588.136161:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 55 pid: 57561 timeout: 3415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136173:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 55 pid: 57561 timeout: 3415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136206:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1913fca9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee22e expref: 55 pid: 57561 timeout: 3415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136221:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:0.0:1779690588.136225:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136234:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136241:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.136270:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690588.136317:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+54:2392:x1866137503783680:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690588.136324:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3309 00010000:00010000:1.0:1779690588.136420:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.136428:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.136460:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.136469:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.136476:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690588.137573:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8e:0x0]: returning size 512 00010000:00010000:1.0:1779690588.137584:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137592:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137598:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137603:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.137607:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137614:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137624:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:1.0:1779690588.137627:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.137631:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.137647:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1913ff49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690588.137665:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e649e4e6 reply state 00000000891a6f1e transno 12884902336 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690588.137674:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690588.137740:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:111613:x1866137503783552:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 10092us (10318us total) trans 12884902336 rc 0/0 00000100:00100000:1.0:1779690588.137748:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1042 00010000:00010000:3.0:1779690588.141262:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141277:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141286:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141293:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690588.141297:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141305:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141320:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (ffff9e2f90442b00) 00010000:00010000:3.0:1779690588.141324:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690588.141328:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690588.141335:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690588.167385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.167833:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783808 00000100:00100000:2.0:1779690588.167842:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783808 00000100:00100000:2.0:1779690588.167907:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1043 00000100:00100000:2.0:1779690588.167917:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:111617:x1866137503783808:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690588.167935:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690588.167955:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913ff57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2ba expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.168026:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.168040:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.168050:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690588.168103:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690588.168107:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 113 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690588.168126:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.170044:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1913ff57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ba expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.170063:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ba expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.170072:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:2.0:1779690588.170075:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690588.170078:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690588.170149:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:111617:x1866137503783808:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 2233us (2772us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690588.170158:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1043 00000100:00100000:1.0:1779690588.180360:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690588.180470:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503783936 00000100:00100000:0.0:1779690588.180479:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503783936 00000100:00100000:0.0:1779690588.180591:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1044 00000100:00100000:0.0:1779690588.180602:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:111618:x1866137503783936:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690588.180621:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690588.180638:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2c1 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180692:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180721:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180732:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180801:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180860:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180866:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180925:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180933:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180939:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180944:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690588.180947:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180954:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180964:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:0.0:1779690588.180972:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.180977:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180983:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ff6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.180995:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181000:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181006:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181010:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690588.181012:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181018:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181024:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690588.181026:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.181028:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181033:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ff73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181060:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c1 expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181080:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:0.0:1779690588.181083:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.181088:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e600/0xb4bb873a1913ff65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c1 expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.181097:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e600, rc 0) 00000100:00100000:0.0:1779690588.181156:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:111618:x1866137503783936:12345-192.168.203.5@tcp:101:rm.0 Request processed in 556us (804us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690588.181164:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1044 00000100:00100000:0.0:1779690588.201007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690588.201170:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784192 00000100:00100000:1.0:1779690588.201179:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784192 00000100:00100000:1.0:1779690588.201239:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1045 00000100:00100000:1.0:1779690588.201371:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:111619:x1866137503784192:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:1.0:1779690588.201391:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690588.201394:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1779690588.201418:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1913ff5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2ba expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201437:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:1.0:1779690588.201448:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690588.201461:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2c8 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201568:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201596:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201606:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201620:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201627:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.201633:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690588.202440:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f0:0x0], index 1: 0 00010000:00010000:1.0:1779690588.202589:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202599:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202606:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202635:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202642:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202648:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202660:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b86e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.202665:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202672:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202681:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442000) 00010000:00010000:1.0:1779690588.202684:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.202688:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202693:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ff81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690588.202706:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005aca8b84 reply state 00000000a4a51721 transno 12884902337 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690588.202713:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1779690588.202739:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ff7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202753:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.202759:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690588.202761:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690588.202763:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86600, rc 0) 00000100:00100000:1.0:1779690588.202858:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+57:111619:x1866137503784192:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1491us (1858us total) trans 12884902337 rc 0/0 00000100:00100000:1.0:1779690588.202873:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1045 00010000:00010000:0.0:1779690588.205260:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205279:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205287:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205294:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690588.205298:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205435:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205454:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f90442a00) 00010000:00010000:0.0:1779690588.205457:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690588.205479:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.205487:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ff88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690588.233800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.233972:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784320 00000100:00100000:2.0:1779690588.233981:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784320 00000100:00100000:2.0:1779690588.234059:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6481 00000100:00100000:2.0:1779690588.234068:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+12:111619:x1866137503784320:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1779690588.234085:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690588.234205:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2cf expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690588.234231:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1779690588.234304:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690588.234307:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690588.234316:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 13 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.234332:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 13 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.234344:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690588.234452:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:111619:x1866137503784320:12345-192.168.203.5@tcp:101:dd.0 Request processed in 385us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690588.234459:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6481 00000100:00080000:0.0:1779690588.234680:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690588.256575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690588.256770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690588.256930:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784448 00000100:00100000:1.0:1779690588.256943:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784448 00002000:00100000:1.0:1779690588.257015:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1f0:0x0] (0->1048575) req@ffff9e30865e4000 x1866137503784448/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:69/0 lens 488/0 e 0 to 0 dl 1779690599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690588.257032:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30865e4000 with x1866137503784448 ext(0->1048575) 00002000:00010000:1.0:1779690588.257039:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30865e4000 00000100:00100000:1.0:1779690588.257080:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2084 00000100:00100000:1.0:1779690588.257090:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503784448:12345-192.168.203.5@tcp:4:dd.0 00000100:00100000:2.0:1779690588.257179:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784704 00000100:00100000:2.0:1779690588.257185:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784704 00000100:00100000:2.0:1779690588.257252:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:2.0:1779690588.257261:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+56:111619:x1866137503784704:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:2.0:1779690588.257681:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+57:111619:x1866137503784704:12345-192.168.203.5@tcp:35:dd.0 Request processed in 420us (909us total) trans 12884902338 rc 0/0 00000100:00100000:2.0:1779690588.257696:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:2.0:1779690588.284281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690588.284458:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784832 00000100:00100000:0.0:1779690588.284471:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784832 00000100:00100000:0.0:1779690588.284572:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1046 00000100:00100000:0.0:1779690588.284586:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:111620:x1866137503784832:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690588.284674:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690588.284705:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ffa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2d6 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.284783:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.284800:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.284835:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690588.284907:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690588.284912:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690588.284944:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.284985:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e000/0xb4bb873a1913ffa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.285024:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.285034:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690588.285037:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690588.285041:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:1.0:1779690588.285088:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503784448:12345-192.168.203.5@tcp:4:dd.0 Request processed in 27996us (28524us total) trans 4294968448 rc 0/0 00000100:00100000:1.0:1779690588.285101:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2084 00002000:00100000:1.0:1779690588.285114:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x1f0:0x0] (0->1048575) req@ffff9e30865e4000 x1866137503784448/t4294968448(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:69/0 lens 488/448 e 0 to 0 dl 1779690599 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690588.285125:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30865e4000 with x1866137503784448 ext(0->1048575) 00002000:00010000:1.0:1779690588.285130:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30865e4000 00000100:00100000:0.0:1779690588.285190:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+58:111620:x1866137503784832:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 609us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690588.285198:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1046 00000100:00100000:0.0:1779690588.312681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690588.312956:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503784960 00000100:00100000:1.0:1779690588.312970:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503784960 00000100:00100000:1.0:1779690588.313044:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1047 00000100:00100000:1.0:1779690588.313058:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+53:111622:x1866137503784960:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690588.313092:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690588.313119:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ffb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2dd expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313227:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313245:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313259:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690588.313338:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690588.313343:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690588.313373:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313402:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1913ffb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2dd expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313428:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2dd expref: 54 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.313438:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:1.0:1779690588.313441:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690588.313445:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86000, rc 0) 00000100:00100000:1.0:1779690588.313647:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+54:111622:x1866137503784960:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 591us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690588.313655:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1047 00000100:00100000:3.0:1779690588.318775:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690588.322470:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785088 00000100:00100000:1.0:1779690588.322488:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785088 00000100:00100000:1.0:1779690588.322589:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1048 00000100:00100000:1.0:1779690588.322602:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:111622:x1866137503785088:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690588.322630:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690588.322655:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913ffc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2e4 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322738:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322756:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322769:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322786:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322793:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322799:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322963:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322973:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.322980:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690588.323031:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00000004:00200000:1.0:1779690588.323037:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690588.323060:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323073:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323083:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323091:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323099:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323105:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.323110:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323118:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323132:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:1.0:1779690588.323135:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.323141:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323148:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87a00/0xb4bb873a1913ffc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323177:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323184:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323191:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323196:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690588.323199:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323205:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323212:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f90442000) 00010000:00010000:1.0:1779690588.323215:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690588.323218:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323223:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a1913ffce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323258:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913ffc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323273:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690588.323512:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690588.323515:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690588.323518:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e400, rc 0) 00000100:00100000:1.0:1779690588.323646:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+55:111622:x1866137503785088:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1046us (4882us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690588.323654:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1048 00000100:00100000:3.0:1779690588.327721:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.327905:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785216 00000100:00100000:2.0:1779690588.327917:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785216 00000100:00100000:2.0:1779690588.328016:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6482 00000100:00100000:2.0:1779690588.328029:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503785216:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690588.328051:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690588.328075:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913ffdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2eb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1779690588.328116:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690588.328163:0:22747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492359936:192.168.203.5@tcp:106: 00000100:00100000:2.0:1779690588.328287:0:22747:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82f91cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1779690588.331306:0:22747:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x1f0:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1779690588.331316:0:22747:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x1f0:0x0] updating lvb mtime: 0 -> 1779690588 00002000:00010000:2.0:1779690588.331319:0:22747:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x1f0:0x0] updating lvb atime: 0 -> 1779690588 00002000:00010000:2.0:1779690588.331497:0:22747:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x1f0:0x0] updating lvb ctime: 0 -> 1779690588 00000100:00100000:2.0:1779690588.331529:0:22747:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:22747:1866137492359936:192.168.203.5@tcp:106: 00010000:00010000:2.0:1779690588.331576:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913ffdc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2eb expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.331606:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009991808f/0xb4bb873a1913ffdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2eb expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690588.331623:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e000, rc 0) 00000100:00100000:2.0:1779690588.331746:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503785216:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3718us (4037us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690588.331756:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6482 00000100:00100000:0.0:1779690588.337524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690588.338109:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785344 00000100:00100000:3.0:1779690588.338122:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785344 00000100:00100000:3.0:1779690588.338196:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6483 00000100:00100000:3.0:1779690588.338208:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503785344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690588.338233:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690588.338256:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006837ea40/0xb4bb873a1913ffe3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2f2 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690588.338348:0:40949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492360064:192.168.203.5@tcp:106: 00000100:00100000:3.0:1779690588.338454:0:40949:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f83460a80 going to sleep for 11 seconds 00000100:00100000:0.0:1779690588.341914:0:40949:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:40949:1866137492360064:192.168.203.5@tcp:106: 00010000:00010000:0.0:1779690588.341960:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006837ea40/0xb4bb873a1913ffe3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2f2 expref: 9 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.341984:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006837ea40/0xb4bb873a1913ffe3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2f2 expref: 9 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690588.341996:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f81267c00, rc 0) 00000100:00100000:0.0:1779690588.342130:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503785344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3922us (4617us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690588.342140:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6483 00000100:00100000:0.0:1779690588.347921:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690588.348151:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785600 00000100:00100000:2.0:1779690588.348164:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785600 00000100:00100000:2.0:1779690588.348233:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1049 00000100:00100000:2.0:1779690588.348244:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+55:111622:x1866137503785600:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690588.349238:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].41, 136 off13768 00000100:00100000:2.0:1779690588.349470:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+55:111622:x1866137503785600:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1222us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690588.349481:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1049 00010000:00010000:3.0:1779690588.616978:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690588.899334:0:72884:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690588.899342:0:72884:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690588.899414:0:72884:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 42 count 11 00000040:00080000:2.0:1779690588.899419:0:72884:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690589.065103:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690589.065110:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690589.065145:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 42 count 11 00000040:00080000:2.0:1779690589.065151:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690589.070450:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492360192:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690589.070592:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690589.074023:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492360192:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690589.078550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.079773:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785728 00000100:00100000:0.0:1779690589.079785:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785728 00000100:00100000:0.0:1779690589.079866:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1050 00000100:00100000:0.0:1779690589.079876:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:111633:x1866137503785728:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690589.079906:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690589.080004:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:111633:x1866137503785728:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.080011:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1050 00000100:00100000:0.0:1779690589.090736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.090877:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503785984 00000100:00100000:1.0:1779690589.090886:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503785984 00000100:00100000:1.0:1779690589.090937:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1051 00000100:00100000:1.0:1779690589.090947:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+58:111633:x1866137503785984:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690589.090966:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690589.090985:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913ffea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee2f9 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.091092:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fff1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.091107:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.091120:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690589.091131:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:1.0:1779690589.091252:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1913ffea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2f9 expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.091289:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fff1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2f9 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.091297:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690589.091300:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690589.091303:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87e00, rc 0) 00000100:00100000:1.0:1779690589.091362:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503785984:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 416us (634us total) trans 12884902339 rc 0/0 00000100:00100000:1.0:1779690589.091369:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1051 00000100:00100000:2.0:1779690589.094934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690589.094976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.095056:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503786240 00000100:00100000:0.0:1779690589.095065:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503786240 00000100:00100000:3.0:1779690589.095121:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503786112 00000100:00100000:3.0:1779690589.095127:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503786112 00000100:00100000:0.0:1779690589.095129:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18683 00000100:00100000:0.0:1779690589.095141:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+60:2391:x1866137503786240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690589.095157:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1779690589.095177:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6484 00010000:00010000:0.0:1779690589.095184:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a1913fff1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2f9 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690589.095189:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503786112:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690589.095225:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690589.095229:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.095232:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690589.095283:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503786240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 145us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.095290:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18683 00010000:00010000:3.0:1779690589.095356:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 15 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.095366:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690589.095380:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690589.095384:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.095416:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 15 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.095430:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 15 pid: 10273 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690589.095444:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492360320:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690589.095576:0:6583:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f83460780 going to sleep for 11 seconds 00000100:00100000:2.0:1779690589.098752:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.098893:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503786368 00000100:00100000:1.0:1779690589.098902:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503786368 00010000:00010000:1.0:1779690589.098936:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 16 pid: 10273 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690589.098966:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3310 00000100:00100000:1.0:1779690589.098974:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+16:2391:x1866137503786368:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690589.098987:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690589.099009:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 16 pid: 10273 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690589.099021:0:6583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492360320:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690589.099024:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 16 pid: 10273 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.099048:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e73bb2a/0xb4bb873a1913ff9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2cf expref: 16 pid: 10273 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.099050:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.099084:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690589.099086:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690589.099090:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.099099:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.099129:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690589.099186:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503786368:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 211us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690589.099192:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3310 00010000:00010000:3.0:1779690589.100353:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100367:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100395:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100403:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100420:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100427:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f81267600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690589.100432:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100440:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100455:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690589.100462:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024613461/0xb4bb873a1913ffff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690589.100567:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+14:2392:x1866137503786112:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 5380us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690589.100576:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6484 00000100:00100000:2.0:1779690589.106176:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.107962:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503786624 00000100:00100000:0.0:1779690589.107975:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503786624 00000100:00100000:0.0:1779690589.108101:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1052 00000100:00100000:0.0:1779690589.108112:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:111633:x1866137503786624:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690589.108250:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+59:111633:x1866137503786624:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 139us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.108258:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1052 00000100:00100000:3.0:1779690589.111560:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.111869:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503786752 00000100:00100000:1.0:1779690589.111879:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503786752 00000100:00100000:1.0:1779690589.111929:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6485 00000100:00100000:1.0:1779690589.111939:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503786752:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690589.111956:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690589.111975:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee300 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690589.112002:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f0:0x0] initial LVB size: 1048576, mtime: 0x6a13ec5c, atime: 0x0, ctime: 0x6a13ec5c, blocks: 0x1 00010000:00010000:1.0:1779690589.112018:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690589.112021:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690589.112028:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.112059:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.112070:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87a00, rc 0) 00000100:00100000:1.0:1779690589.112128:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503786752:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 190us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690589.112134:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6485 00000100:00100000:1.0:1779690589.130047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.130308:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787008 00000100:00100000:0.0:1779690589.130317:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787008 00000100:00100000:0.0:1779690589.130375:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1053 00000100:00100000:0.0:1779690589.130384:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f91332c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:111633:x1866137503787008:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690589.130492:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f91332c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:111633:x1866137503787008:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 107us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.130500:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1053 00000100:00100000:2.0:1779690589.142406:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690589.142533:0:6588:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787136 00000100:00100000:3.0:1779690589.142543:0:6588:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787136 00002000:00100000:3.0:1779690589.142590:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1f0:0x0] (0->1048575) req@ffff9e30847d3100 x1866137503787136/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:70/0 lens 488/0 e 0 to 0 dl 1779690600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690589.142602:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30847d3100 with x1866137503787136 ext(0->1048575) 00002000:00010000:3.0:1779690589.142622:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30847d3100 00000100:00100000:3.0:1779690589.142656:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2085 00000100:00100000:3.0:1779690589.142666:0:6588:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503787136:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1779690589.166354:0:6588:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503787136:12345-192.168.203.5@tcp:3:lhsmtool_posix.0 Request processed in 23681us (23948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1779690589.166367:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2085 00002000:00100000:3.0:1779690589.166379:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1f0:0x0] (0->1048575) req@ffff9e30847d3100 x1866137503787136/t0(0) o3->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:70/0 lens 488/440 e 0 to 0 dl 1779690600 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690589.166389:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30847d3100 with x1866137503787136 ext(0->1048575) 00002000:00010000:3.0:1779690589.166395:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e30847d3100 00000100:00100000:0.0:1779690589.183026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.183244:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787264 00000100:00100000:1.0:1779690589.183253:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787264 00000100:00100000:1.0:1779690589.183306:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1054 00000100:00100000:1.0:1779690589.183317:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:111633:x1866137503787264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690589.183335:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690589.183355:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1914000d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee307 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183388:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183401:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183417:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183510:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86e00/0xb4bb873a1914000d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183537:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.183547:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690589.183550:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690589.183553:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b87c00, rc 0) 00000100:00100000:1.0:1779690589.183611:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503787264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 296us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690589.183618:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1054 00000100:00100000:1.0:1779690589.186577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.186661:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787392 00000100:00100000:0.0:1779690589.186669:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787392 00000100:00100000:0.0:1779690589.186848:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1055 00000100:00100000:0.0:1779690589.186858:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503787392:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690589.186885:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690589.186963:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503787392:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 106us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.186970:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1055 00000100:00100000:3.0:1779690589.189518:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690589.189623:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787520 00000100:00100000:2.0:1779690589.189631:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787520 00000100:00100000:2.0:1779690589.189679:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6486 00000100:00100000:2.0:1779690589.189703:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503787520:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690589.189739:0:10273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189753:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690589.189755:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690589.189760:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189771:0:10273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189799:0:10273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189846:0:10273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189856:0:10273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189863:0:10273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690589.189868:0:10273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189879:0:10273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189905:0:10273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690589.189913:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008796cc12/0xb4bb873a1914001b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690589.189993:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503787520:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 292us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690589.190001:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6486 00000100:00100000:2.0:1779690589.193013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.193054:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787776 00000100:00100000:1.0:1779690589.193063:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787776 00000100:00100000:1.0:1779690589.193117:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1056 00000100:00100000:1.0:1779690589.193126:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503787776:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690589.193195:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.193213:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.193223:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.193259:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.193289:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 60 pid: 57560 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690589.193303:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492360448:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690589.193391:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690589.196672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.196901:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492360448:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690589.196927:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690589.196986:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503787904 00000100:00100000:0.0:1779690589.196992:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503787904 00010000:00010000:0.0:1779690589.197020:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 61 pid: 57560 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690589.197053:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3311 00000100:00100000:0.0:1779690589.197060:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+61:2391:x1866137503787904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690589.197083:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690589.197089:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 61 pid: 57560 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197101:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 61 pid: 57560 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197121:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87c00/0xb4bb873a19140014 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee307 expref: 61 pid: 57560 timeout: 3416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197136:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:0.0:1779690589.197140:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197149:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197157:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690589.197181:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690589.197222:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+60:2391:x1866137503787904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 162us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690589.197229:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3311 00010000:00010000:1.0:1779690589.197284:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197292:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197478:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197486:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197493:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197499:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690589.197502:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197519:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197527:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690589.197530:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690589.197533:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690589.197539:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b87e00/0xb4bb873a19140022 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690589.197650:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503787776:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 4525us (4644us total) trans 12884902340 rc 0/0 00000100:00100000:1.0:1779690589.197658:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1056 00000040:00080000:2.0:1779690589.197800:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690589.197832:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690589.198355:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:2.0:1779690589.198363:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690589.208074:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690589.208126:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788160 00000100:00100000:0.0:1779690589.208134:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788160 00000100:00100000:0.0:1779690589.208177:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:0.0:1779690589.208184:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+60:111633:x1866137503788160:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690589.208460:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+61:111633:x1866137503788160:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 275us (393us total) trans 12884902341 rc 0/0 00000100:00100000:0.0:1779690589.208468:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:3.0:1779690589.638609:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690589.638653:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690589.638685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690589.638763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690589.638785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690589.638913:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788288 00000100:00100000:1.0:1779690589.638923:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788288 00000100:00100000:1.0:1779690589.638980:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:1.0:1779690589.638990:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503788288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690589.639071:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503788288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 82us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690589.639078:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:2.0:1779690589.639320:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788416 00000100:00100000:2.0:1779690589.639325:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788416 00000100:00100000:2.0:1779690589.639373:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788672 00000100:00100000:2.0:1779690589.639376:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788672 00000100:00100000:2.0:1779690589.639392:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788800 00000100:00100000:2.0:1779690589.639395:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788800 00000100:00100000:2.0:1779690589.639410:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2984 00000100:00100000:2.0:1779690589.639417:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503788416:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690589.639449:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503788416:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690589.639471:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2984 00000100:00100000:2.0:1779690589.639487:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2985 00000100:00100000:2.0:1779690589.639494:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503788672:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690589.639520:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+17:2390:x1866137503788672:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690589.639526:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2985 00000100:00100000:2.0:1779690589.639537:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2986 00000100:00100000:2.0:1779690589.639542:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503788800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690589.639565:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+8:2389:x1866137503788800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690589.639570:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2986 00000100:00100000:2.0:1779690589.639590:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788544 00000100:00100000:2.0:1779690589.639593:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788544 00000100:00100000:2.0:1779690589.639617:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 297 00000100:00100000:2.0:1779690589.639623:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2389:x1866137503788544:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690589.639651:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+55:2389:x1866137503788544:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690589.639657:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 297 00000100:00080000:1.0:1779690589.639778:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690589.641038:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690590.491351:0:72935:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690590.491358:0:72935:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690590.491428:0:72935:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 42 count 11 00000040:00080000:3.0:1779690590.491433:0:72935:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690590.538124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690590.539162:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503788928 00000100:00100000:1.0:1779690590.539172:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503788928 00000100:00100000:1.0:1779690590.539245:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6487 00000100:00100000:1.0:1779690590.539255:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503788928:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690590.539272:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690590.539296:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee30e expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.539321:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.539323:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.539331:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.539349:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.539363:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3089b86e00, rc 0) 00000100:00080000:2.0:1779690590.539420:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690590.539420:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503788928:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 166us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.539427:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6487 00000100:00100000:1.0:1779690590.545007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.545097:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789184 00000100:00100000:2.0:1779690590.545106:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789184 00000100:00100000:2.0:1779690590.545175:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1057 00000100:00100000:2.0:1779690590.545185:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+55:111641:x1866137503789184:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690590.545204:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690590.545230:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a19140030 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee315 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.545320:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.545335:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.545347:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690590.545359:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690590.545483:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a19140030 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee315 expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.545499:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee315 expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.545507:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:2.0:1779690590.545511:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1779690590.545514:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:2.0:1779690590.545564:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+57:111641:x1866137503789184:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 380us (563us total) trans 12884902342 rc 0/0 00000100:00100000:2.0:1779690590.545571:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1057 00000100:00080000:1.0:1779690590.545887:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690590.548261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690590.548638:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789312 00000100:00100000:1.0:1779690590.548646:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789312 00000100:00100000:1.0:1779690590.548703:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6488 00000100:00100000:1.0:1779690590.548712:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+9:2390:x1866137503789312:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:1.0:1779690590.548886:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.548905:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 14 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.548926:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.548933:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.548935:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.548939:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.548968:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 9 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.548981:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 9 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.548994:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492360576:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690590.549086:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 14 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.549096:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 14 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.549105:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492360704:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690590.549129:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848abb40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690590.551754:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492360576:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690590.551769:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492360704:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690590.551794:0:22279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.554908:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.554940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690590.555005:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789440 00000100:00100000:1.0:1779690590.555013:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789440 00010000:00010000:1.0:1779690590.555060:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.555091:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789568 00000100:00100000:1.0:1779690590.555094:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789568 00010000:00010000:1.0:1779690590.555107:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 10 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.555129:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3312 00000100:00100000:1.0:1779690590.555138:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+15:2391:x1866137503789440:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690590.555151:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690590.555170:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555182:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555203:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afb6c3c/0xb4bb873a19140006 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee300 expref: 15 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555231:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690590.555280:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503789440:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 142us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.555287:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3312 00000100:00100000:1.0:1779690590.555303:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3313 00000100:00100000:1.0:1779690590.555310:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503789568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690590.555317:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690590.555325:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 10 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555336:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 10 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555349:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013bda504/0xb4bb873a19140029 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee30e expref: 10 pid: 6581 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555359:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.555361:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690590.555365:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555374:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555407:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690590.555426:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503789568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 116us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.555432:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3313 00010000:00010000:1.0:1779690590.555517:0:22279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555526:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555549:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555557:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555565:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555572:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3089b87e00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690590.555576:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555584:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555607:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.555614:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de82d10/0xb4bb873a19140045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.555657:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+8:2390:x1866137503789312:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 6947us (7404us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.555664:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6488 00000100:00080000:3.0:1779690590.555902:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690590.558167:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690590.558229:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789824 00000100:00100000:1.0:1779690590.558236:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789824 00000100:00100000:1.0:1779690590.558287:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:1.0:1779690590.558296:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+57:111641:x1866137503789824:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:1.0:1779690590.558348:0:57562:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x28:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee315 expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690590.558546:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902343 00000001:00080000:1.0:1779690590.559098:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902344 00010000:00010000:1.0:1779690590.559156:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559171:0:57562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559179:0:57562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559199:0:57562:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559229:0:57562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559243:0:57562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 60 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.559257:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492360832:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690590.559338:0:57562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.559348:0:57562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 60 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.559356:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492360960:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690590.559377:0:57562:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f848abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690590.563126:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492360960:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690590.574575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.574659:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492360832:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690590.574687:0:57562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690590.574754:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503789952 00000100:00100000:0.0:1779690590.574762:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503789952 00010000:00010000:0.0:1779690590.574832:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690590.574862:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3314 00000100:00100000:0.0:1779690590.574871:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+61:2392:x1866137503789952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690590.574884:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690590.574890:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690590.574901:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690590.574923:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86600/0xb4bb873a1913ff8f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2c8 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690590.574937:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:0.0:1779690590.574942:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690590.574951:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690590.574968:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690590.575013:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+60:2392:x1866137503789952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 143us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690590.575021:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3314 00000100:00080000:3.0:1779690590.575421:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690590.579231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.579424:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503790080 00000100:00100000:3.0:1779690590.579433:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503790080 00010000:00010000:3.0:1779690590.579466:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.579507:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3315 00000100:00100000:3.0:1779690590.579516:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+61:2391:x1866137503790080:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690590.579528:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690590.579534:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579546:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579565:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1913ffd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2e4 expref: 61 pid: 57560 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579581:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690590.579586:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579607:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579615:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579640:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690590.579685:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+60:2391:x1866137503790080:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 170us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690590.579692:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3315 00010000:00010000:3.0:1779690590.579845:0:57562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.579853:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690590.579969:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902345 00000001:00080000:3.0:1779690590.580146:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902346 00000001:00080000:3.0:1779690590.580202:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902347 00000100:00100000:3.0:1779690590.580283:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492361088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1779690590.580319:0:57562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690590.580337:0:57562:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f83460e40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690590.580584:0:6591:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492361088 00000100:00100000:1.0:1779690590.580589:0:6591:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492361088 00000100:00100000:1.0:1779690590.580630:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1779690590.580637:0:6591:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57562:x1866137492361088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1779690590.580699:0:6591:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57562:x1866137492361088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.580715:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00080000:3.0:1779690590.580919:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690590.581037:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492361088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1779690590.582412:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902348 00000100:00100000:3.0:1779690590.582481:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492361216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1779690590.582520:0:57562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690590.582586:0:57562:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f83460540 going to sleep for 11 seconds 00000100:00100000:1.0:1779690590.583081:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492361216 00000100:00100000:1.0:1779690590.583087:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492361216 00000100:00100000:1.0:1779690590.583158:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1779690590.583167:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57562:x1866137492361216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1779690590.583350:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57562:x1866137492361216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 184us (827us total) trans 4294968449 rc 0/0 00000100:00100000:1.0:1779690590.583357:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:3.0:1779690590.583419:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492361216:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1779690590.583439:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583449:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583457:0:57562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583464:0:57562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690590.583468:0:57562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583476:0:57562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583489:0:57562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690590.583492:0:57562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1779690590.583497:0:57562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.583503:0:57562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a1914004c lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690590.583757:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x8f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1779690590.583889:0:57562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].10, 64 off8904 00000004:00080000:3.0:1779690590.583900:0:57562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3318158094002ns, next at 3319158092187ns, rc = 0 00000001:00080000:3.0:1779690590.583907:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902349 00010000:00010000:3.0:1779690590.587064:0:57562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690590.587073:0:57562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690590.587089:0:57562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140037 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee315 expref: 64 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.587216:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+63:111641:x1866137503789824:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 28920us (29052us total) trans 12884902350 rc 0/0 00000100:00100000:3.0:1779690590.587225:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 137 00000020:00080000:3.0:1779690590.587230:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1779690590.608123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.608183:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503790336 00000100:00100000:2.0:1779690590.608192:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503790336 00000100:00100000:2.0:1779690590.608245:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1058 00000100:00100000:2.0:1779690590.608269:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+63:111644:x1866137503790336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690590.608301:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690590.608318:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee31c expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608387:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608401:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608411:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608424:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608431:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608437:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608555:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140068 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608562:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140068 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608569:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140068 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690590.608587:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690590.608670:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608678:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608684:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608689:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690590.608693:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608700:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608710:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:2.0:1779690590.608713:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690590.608718:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608724:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914005a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608734:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608739:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608755:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608760:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690590.608762:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608768:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608776:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f90226600) 00010000:00010000:2.0:1779690590.608779:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690590.608781:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608787:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140061 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608855:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee31c expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608868:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140068 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee31c expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.608875:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:2.0:1779690590.608877:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690590.608879:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690590.608932:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+65:111644:x1866137503790336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 666us (817us total) trans 12884902351 rc 0/0 00000100:00100000:2.0:1779690590.608948:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1058 00000100:00100000:0.0:1779690590.613387:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690590.613867:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503790464 00000100:00100000:1.0:1779690590.613875:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503790464 00000100:00100000:1.0:1779690590.613922:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1059 00000100:00100000:1.0:1779690590.613932:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+65:111644:x1866137503790464:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1779690590.613986:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614001:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614011:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614032:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614039:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614045:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614059:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690590.614074:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614081:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614091:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:1.0:1779690590.614094:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690590.614097:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.614102:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a19140076 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690590.614169:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+65:111644:x1866137503790464:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 238us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.614182:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1059 00000100:00100000:0.0:1779690590.616669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.617155:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503790720 00000100:00100000:2.0:1779690590.617163:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503790720 00000100:00100000:2.0:1779690590.617201:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:2.0:1779690590.617209:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:111644:x1866137503790720:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1779690590.617409:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:111644:x1866137503790720:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 200us (744us total) trans 12884902352 rc 0/0 00000100:00100000:2.0:1779690590.617416:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:0.0:1779690590.652237:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.652338:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503790976 00000100:00100000:3.0:1779690590.652347:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503790976 00000100:00100000:3.0:1779690590.652660:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1060 00000100:00100000:3.0:1779690590.652672:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:111649:x1866137503790976:12345-192.168.203.5@tcp:101:filefrag.0 00010000:00010000:3.0:1779690590.652705:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690590.652723:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914007d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee323 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.652848:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140084 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.652862:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140084 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.652874:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140084 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690590.652885:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:3.0:1779690590.653023:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914007d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee323 expref: 69 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.653039:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140084 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee323 expref: 68 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.653064:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690590.653067:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1779690590.653071:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b000, rc 0) 00000100:00100000:3.0:1779690590.653132:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:111649:x1866137503790976:12345-192.168.203.5@tcp:101:filefrag.0 Request processed in 463us (902us total) trans 12884902353 rc 0/0 00000100:00100000:3.0:1779690590.655030:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1060 00000100:00100000:2.0:1779690590.658102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690590.658451:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503791104 00000100:00100000:0.0:1779690590.658460:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503791104 00000100:00100000:0.0:1779690590.658517:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1061 00000100:00100000:0.0:1779690590.658529:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:111649:x1866137503791104:12345-192.168.203.5@tcp:41:filefrag.0 00000004:00000024:0.0:1779690590.658594:0:57559:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 7588544512 avail 7582253056 00000100:00100000:0.0:1779690590.658665:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:111649:x1866137503791104:12345-192.168.203.5@tcp:41:filefrag.0 Request processed in 138us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690590.658673:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1061 00010000:00010000:1.0:1779690590.664978:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690590.674894:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.675419:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503791232 00000100:00100000:2.0:1779690590.675770:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503791232 00000100:00100000:2.0:1779690590.675852:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1062 00000100:00100000:2.0:1779690590.675864:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:111652:x1866137503791232:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690590.675883:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690590.675901:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee32a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.675964:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.675978:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.675990:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676004:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676021:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676029:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676509:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676518:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676525:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676532:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690590.676537:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676544:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676557:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:2.0:1779690590.676560:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690590.676565:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676571:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a19140099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676587:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676600:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676607:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676613:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690590.676617:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676624:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676634:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (ffff9e2f90226d00) 00010000:00010000:2.0:1779690590.676637:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690590.676640:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676646:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676680:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140092 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee32a expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676691:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:2.0:1779690590.676694:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690590.676698:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee32a expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.676721:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690590.676791:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:111652:x1866137503791232:12345-192.168.203.5@tcp:101:cp.0 Request processed in 929us (1910us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690590.676799:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1062 00000100:00100000:3.0:1779690590.680785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.683588:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503791488 00000100:00100000:2.0:1779690590.683598:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503791488 00000100:00100000:2.0:1779690590.683648:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1063 00000100:00100000:2.0:1779690590.683657:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:111652:x1866137503791488:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690590.683677:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690590.683680:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690590.683704:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3089b86000/0xb4bb873a1913ffb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2dd expref: 68 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.683726:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:2.0:1779690590.683732:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690590.683745:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191400a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee331 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.683990:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.684005:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.684014:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.684052:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.684066:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 59 pid: 57561 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690590.684081:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492361344:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690590.684178:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690590.686216:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492361344:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690590.686243:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.686629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.686661:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503791616 00000100:00100000:3.0:1779690590.686668:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503791616 00010000:00010000:3.0:1779690590.686698:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 60 pid: 57561 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.686731:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3316 00000100:00100000:3.0:1779690590.686742:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+60:2391:x1866137503791616:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690590.686755:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690590.686762:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 60 pid: 57561 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.686774:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 60 pid: 57561 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.686794:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34f200/0xb4bb873a1913ffab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee2d6 expref: 60 pid: 57561 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.688044:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:3.0:1779690590.688050:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.688059:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.688067:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.688099:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690590.688118:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.688128:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.688151:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.688161:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.688164:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503791616:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1421us (1533us total) trans 0 rc 0/0 00010000:00010000:2.0:1779690590.688175:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.688242:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3316 00000004:00080000:2.0:1779690590.690314:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f1:0x0], index 0: 0 00010000:00010000:3.0:1779690590.692137:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a191400bc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692158:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a191400bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692169:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a191400bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692206:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692214:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692222:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692236:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690590.692241:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692249:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692261:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:3.0:1779690590.692264:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690590.692282:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692289:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a191400ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690590.692304:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000074575faa reply state 0000000014f8f869 transno 12884902354 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.692313:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1779690590.692350:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191400a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee331 expref: 70 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692372:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a191400bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee331 expref: 69 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.692380:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x90:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690590.692383:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690590.692386:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4a000, rc 0) 00000100:00100000:3.0:1779690590.692450:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+70:111652:x1866137503791488:12345-192.168.203.5@tcp:101:cp.0 Request processed in 8794us (11675us total) trans 12884902354 rc 0/0 00000100:00100000:3.0:1779690590.692465:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1063 00000100:00100000:3.0:1779690590.695213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1779690590.695248:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695260:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695267:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695274:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690590.695279:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695309:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695325:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (ffff9e2f90226600) 00010000:00010000:3.0:1779690590.695328:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690590.695333:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.695339:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690590.695483:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503791744 00000100:00100000:3.0:1779690590.695492:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503791744 00000100:00100000:3.0:1779690590.695533:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6489 00000100:00100000:3.0:1779690590.695543:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503791744:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:3.0:1779690590.695564:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690590.695579:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee338 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690590.695603:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690590.695618:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690590.695621:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690590.696640:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.696664:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.696677:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4ac00, rc 0) 00000100:00100000:3.0:1779690590.696735:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503791744:12345-192.168.203.5@tcp:101:cp.0 Request processed in 1193us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690590.696744:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6489 00000001:00080000:2.0:1779690590.699003:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968449 is committed 00000001:00080000:2.0:1779690590.699021:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968448 is committed 00000100:00100000:1.0:1779690590.702151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690590.702206:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792000 00000100:00100000:3.0:1779690590.702216:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792000 00000100:00100000:3.0:1779690590.702281:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18684 00000100:00100000:3.0:1779690590.702292:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+69:111652:x1866137503792000:12345-192.168.203.5@tcp:103:cp.0 00010000:00010000:3.0:1779690590.702306:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1779690590.702328:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140084 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee323 expref: 69 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.702347:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140068 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee31c expref: 68 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.702366:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690590.702377:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690590.702431:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+67:111652:x1866137503792000:12345-192.168.203.5@tcp:103:cp.0 Request processed in 140us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690590.702439:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18684 00000001:00080000:1.0:1779690590.703915:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902341 is committed 00000001:00080000:1.0:1779690590.703931:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902345 is committed 00000001:00080000:1.0:1779690590.704002:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902352 is committed 00000001:00080000:1.0:1779690590.704030:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902353 is committed 00000004:00080000:1.0:1779690590.704037:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000020:00080000:1.0:1779690590.704053:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f83460e40 refcount 2 committed 0 result 0 batchid 8590018968 00000020:00080000:1.0:1779690590.704056:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088c5dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f83460c00 00000020:00080000:1.0:1779690590.704059:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088c5dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f81a3cc00 00000020:00080000:2.0:1779690590.704174:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018968 committed batchid 8590018967 00000100:00100000:3.0:1779690590.704289:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492361472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1779690590.704335:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1779690590.704358:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018967 00000100:00100000:3.0:1779690590.704416:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492361472 00000100:00100000:3.0:1779690590.704421:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492361472 00000100:00100000:3.0:1779690590.704492:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6490 00000100:00100000:3.0:1779690590.704502:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492361472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1779690590.704532:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:496 count 1 00000100:00100000:1.0:1779690590.704544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00002000:00010000:3.0:1779690590.704557:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f0:0x0] initial LVB size: 1048576, mtime: 0x6a13ec5c, atime: 0x0, ctime: 0x6a13ec5c, blocks: 0x803 00010000:00010000:3.0:1779690590.704563:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.704576:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690590.704577:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690590.704581:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.704590:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.704597:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.704607:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690590.704622:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1779690590.704666:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1779690590.704673:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.704683:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ba00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690590.704687:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.704697:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.704712:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.704719:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045785a91/0xb4bb873a191400d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.704738:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690590.704740:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690590.704742:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690590.704945:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792128 00000100:00100000:2.0:1779690590.704950:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792128 00000100:00100000:2.0:1779690590.705047:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1064 00000100:00100000:2.0:1779690590.705057:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503792128:12345-192.168.203.5@tcp:58:cp.0 00000100:00100000:3.0:1779690590.705118:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492361472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 617us (781us total) trans 4294968450 rc 0/0 00000100:00100000:3.0:1779690590.705125:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6490 00010000:00010000:2.0:1779690590.705144:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.705158:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690590.705166:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690590.705346:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].42, 136 off13904 00000100:00100000:2.0:1779690590.705408:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503792128:12345-192.168.203.5@tcp:58:cp.0 Request processed in 353us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690590.705416:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1064 00000100:00100000:1.0:1779690590.706030:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968449 gen 2 00000004:00080000:1.0:1779690590.706036:0:3319:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968449 committed transno 4294968449 00000100:00100000:1.0:1779690590.706056:0:3319:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e308678ce00 x1866137492361472/t4294968450(4294968450) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1779690606 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1779690590.706155:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e308678ce00/2, rc 0, transno 4294968450 00000100:00100000:1.0:1779690590.706161:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492361472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1779690590.706453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690590.706550:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792256 00000100:00100000:2.0:1779690590.706555:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792256 00000100:00100000:1.0:1779690590.706705:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1065 00000100:00100000:1.0:1779690590.706714:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503792256:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:1.0:1779690590.706726:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690590.706739:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee33f expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706773:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706782:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 4/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706835:0:57585:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706851:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706862:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:1.0:1779690590.706865:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690590.706869:0:57585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 55 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690590.706876:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53ee00, rc 0) 00000100:00100000:1.0:1779690590.706914:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+55:111652:x1866137503792256:12345-192.168.203.5@tcp:101:cp.0 Request processed in 201us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690590.706921:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1065 00000040:00080000:2.0:1779690591.241257:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690591.241276:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690591.241318:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 43 count 12 00000040:00080000:2.0:1779690591.241326:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690591.241443:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492361600:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690591.244474:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690591.247008:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492361600:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690591.249730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.250098:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792384 00000100:00100000:3.0:1779690591.250109:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792384 00000100:00100000:3.0:1779690591.250199:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1066 00000100:00100000:3.0:1779690591.250210:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+53:111653:x1866137503792384:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690591.250241:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690591.250336:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+53:111653:x1866137503792384:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 128us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.250343:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1066 00000100:00100000:0.0:1779690591.256713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.258353:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792512 00000100:00100000:2.0:1779690591.258364:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792512 00000100:00100000:2.0:1779690591.258516:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1067 00000100:00100000:2.0:1779690591.258528:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:111653:x1866137503792512:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.258594:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258612:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258623:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258637:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258644:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258650:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258670:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258677:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258683:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.258717:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00000004:00200000:2.0:1779690591.258733:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690591.258747:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258758:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258764:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258771:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258777:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.258781:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258788:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258798:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690591.258801:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690591.258833:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258840:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191400e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258853:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258859:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258874:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258879:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.258882:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258887:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258894:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4c0c2d98 (ffff9e2f90226d00) 00010000:00010000:2.0:1779690591.258896:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690591.258899:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258904:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191400ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258918:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258923:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258928:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258932:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.258935:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258948:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258956:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:2.0:1779690591.258958:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690591.258961:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.258966:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191400f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.259040:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:111653:x1866137503792512:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 514us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.259048:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1067 00000100:00100000:1.0:1779690591.264412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.264475:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792768 00000100:00100000:2.0:1779690591.264485:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792768 00000100:00100000:2.0:1779690591.264559:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1068 00000100:00100000:2.0:1779690591.264570:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+53:111653:x1866137503792768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.264587:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.264606:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee346 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264691:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264705:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264717:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.264743:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690591.264901:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264909:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264915:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264920:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.264923:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264930:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264941:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:2.0:1779690591.264944:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690591.264948:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264953:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140102 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264989:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400fb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee346 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.264998:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690591.265001:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690591.265011:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191400fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee346 expref: 55 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.265020:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690591.265081:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+54:111653:x1866137503792768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 515us (677us total) trans 12884902355 rc 301/301 00000100:00100000:2.0:1779690591.265089:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1068 00000100:00100000:0.0:1779690591.273498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.273575:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503792896 00000100:00100000:3.0:1779690591.273585:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503792896 00000100:00100000:3.0:1779690591.273643:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1069 00000100:00100000:3.0:1779690591.273651:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:111653:x1866137503792896:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690591.273679:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690591.273767:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+54:111653:x1866137503792896:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.273775:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1069 00000100:00100000:3.0:1779690591.281010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.284068:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503793024 00000100:00100000:2.0:1779690591.284079:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503793024 00000100:00100000:2.0:1779690591.284138:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1070 00000100:00100000:2.0:1779690591.284146:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:111653:x1866137503793024:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.284164:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.284184:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee34d expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284243:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284256:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284277:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.284332:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690591.284336:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690591.284358:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284381:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee34d expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284411:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee34d expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.284419:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226d00) 00010000:00010000:2.0:1779690591.284422:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690591.284425:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690591.284488:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503793024:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 342us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.284495:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1070 00000100:00100000:2.0:1779690591.286883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.286956:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503793280 00000100:00100000:1.0:1779690591.286964:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503793280 00000100:00100000:1.0:1779690591.287009:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1071 00000100:00100000:1.0:1779690591.287017:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503793280:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690591.287033:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.287035:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1779690591.287055:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee34d expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287072:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226d00) 00010000:00010000:1.0:1779690591.287082:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690591.287094:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1914011e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee354 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287859:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140125 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287872:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140125 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287881:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140125 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690591.287890:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x29:0x0]: returning size 0 00010000:00010000:1.0:1779690591.287930:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a1914011e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee354 expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287948:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140125 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee354 expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.287963:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:1.0:1779690591.287966:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690591.287969:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690591.288021:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503793280:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1005us (1144us total) trans 12884902356 rc 0/0 00000100:00100000:1.0:1779690591.288029:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1071 00000100:00100000:1.0:1779690591.291044:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.291122:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503793408 00000100:00100000:2.0:1779690591.291130:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503793408 00000100:00100000:2.0:1779690591.291182:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1072 00000100:00100000:2.0:1779690591.291192:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503793408:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.291223:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.291242:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee35b expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291296:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291310:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291321:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.291391:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690591.291395:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690591.291416:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291437:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee35b expref: 58 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291451:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee35b expref: 57 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.291459:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690591.291461:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690591.291464:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e000, rc 0) 00000100:00100000:2.0:1779690591.291520:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+57:111653:x1866137503793408:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 329us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.291527:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1072 00000100:00100000:2.0:1779690591.298910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.299032:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503793664 00000100:00100000:0.0:1779690591.299040:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503793664 00000100:00100000:0.0:1779690591.299091:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1073 00000100:00100000:0.0:1779690591.299100:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+57:111653:x1866137503793664:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690591.299149:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1779690591.299184:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140125 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee354 expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299205:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:0.0:1779690591.299219:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a1914013a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee35b expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299227:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:0.0:1779690591.299233:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690591.299254:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299266:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299287:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299299:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299305:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299311:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299383:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299390:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299401:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299407:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690591.299411:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299418:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299426:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f500) 00010000:00010000:0.0:1779690591.299428:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690591.299431:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299437:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a19140141 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299449:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299454:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299459:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299464:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690591.299466:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299480:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299487:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed2f2a49 (ffff9e30bf50f400) 00010000:00010000:0.0:1779690591.299489:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690591.299491:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.299497:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a19140148 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed2f2a49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.299572:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503793664:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 472us (670us total) trans 0 rc -2/-2 00000100:00100000:0.0:1779690591.299579:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1073 00000100:00100000:1.0:1779690591.301479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.301551:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503793792 00000100:00100000:3.0:1779690591.301558:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503793792 00000100:00100000:3.0:1779690591.301611:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1074 00000100:00100000:3.0:1779690591.301620:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503793792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690591.301636:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690591.301654:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a1914014f lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee362 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301683:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301695:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301704:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301781:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a1914014f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 57 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301796:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.301841:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690591.301844:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690591.301848:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b800, rc 0) 00000100:00100000:3.0:1779690591.301889:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503793792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 271us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.301896:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1074 00000100:00100000:2.0:1779690591.306929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.307560:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503794048 00000100:00100000:0.0:1779690591.307569:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503794048 00000100:00100000:0.0:1779690591.307624:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1075 00000100:00100000:0.0:1779690591.307634:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503794048:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690591.307704:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.307719:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.307731:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690591.307936:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a586e91b reply state 000000005d7c5365 transno 12884902357 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.307962:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690591.308052:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:111653:x1866137503794048:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 419us (1130us total) trans 12884902357 rc 0/0 00000100:00100000:0.0:1779690591.308059:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1075 00010000:00010000:3.0:1779690591.311784:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311796:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311801:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311854:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34e400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.311859:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311875:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311889:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690591.311893:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690591.311897:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.311904:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e400/0xb4bb873a1914015d lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.313594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.316375:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503794176 00000100:00100000:1.0:1779690591.316387:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503794176 00000100:00100000:1.0:1779690591.316453:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1076 00000100:00100000:1.0:1779690591.316463:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+57:111653:x1866137503794176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690591.316485:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.316504:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee369 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.316560:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 58 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.316574:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 58 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.316583:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:1.0:1779690591.316586:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690591.316589:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:1.0:1779690591.316667:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:111653:x1866137503794176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 206us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.316675:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1076 00000100:00100000:0.0:1779690591.319905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.319990:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503794304 00000100:00100000:2.0:1779690591.319999:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503794304 00000100:00100000:2.0:1779690591.320050:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:2.0:1779690591.320060:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+58:111653:x1866137503794304:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1779690591.320181:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+58:111653:x1866137503794304:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.320204:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:2.0:1779690591.326016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.328962:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503794560 00000100:00100000:0.0:1779690591.328974:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503794560 00000100:00100000:0.0:1779690591.329096:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:0.0:1779690591.329107:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+58:111653:x1866137503794560:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690591.329327:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503794560:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 222us (3320us total) trans 12884902358 rc 0/0 00000100:00100000:0.0:1779690591.329334:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:1.0:1779690591.332918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.333010:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503794816 00000100:00100000:2.0:1779690591.333018:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503794816 00000100:00100000:2.0:1779690591.333076:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1077 00000100:00100000:2.0:1779690591.333085:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503794816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690591.333188:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503794816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.333196:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1077 00000100:00100000:2.0:1779690591.339109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.340446:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795072 00000100:00100000:0.0:1779690591.340456:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795072 00000100:00100000:0.0:1779690591.340699:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1078 00000100:00100000:0.0:1779690591.340711:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503795072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690591.340730:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690591.340749:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1914016b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee370 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.340874:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.340888:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 60 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.340914:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.340946:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 60 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.340961:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 60 pid: 64445 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.340973:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492361728:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690591.341056:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381840 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.347072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.347145:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795200 00000100:00100000:2.0:1779690591.347154:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795200 00010000:00010000:2.0:1779690591.347192:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 61 pid: 64445 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.347245:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3317 00000100:00100000:2.0:1779690591.347254:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+61:2391:x1866137503795200:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690591.347269:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690591.347275:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 61 pid: 64445 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.347287:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 61 pid: 64445 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.347308:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690591.347313:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.347332:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.347340:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.347367:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690591.347430:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+61:2391:x1866137503795200:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 176us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.347437:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3317 00010000:00010000:0.0:1779690591.348367:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140164 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee369 expref: 60 pid: 64445 timeout: 3418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.348389:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492361728:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690591.348409:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.348417:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.348423:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690591.348440:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x29:0x0]: returning size 0 00000004:00080000:0.0:1779690591.348717:0:57559:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f1:0x0], index 1: 0 00010000:00010000:1.0:1779690591.349146:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349155:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349161:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349222:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8a34ec00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690591.349227:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349234:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349246:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:1.0:1779690591.349249:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690591.349252:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349258:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34ec00/0xb4bb873a19140172 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349316:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1914016b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee370 expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349341:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f400) 00010000:00010000:1.0:1779690591.349343:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690591.349348:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8a34e800/0xb4bb873a1914016b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee370 expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.349361:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34e800, rc 0) 00000100:00100000:1.0:1779690591.349419:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503795072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 8710us (10318us total) trans 12884902359 rc 301/301 00000100:00100000:1.0:1779690591.349427:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1078 00000100:00100000:1.0:1779690591.351974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.352130:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795456 00000100:00100000:3.0:1779690591.352138:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795456 00000100:00100000:3.0:1779690591.352198:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1779690591.352209:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+59:111653:x1866137503795456:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690591.352501:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+60:111653:x1866137503795456:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 293us (532us total) trans 12884902360 rc 0/0 00000100:00100000:3.0:1779690591.352508:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1779690591.354331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.354421:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795584 00000100:00100000:2.0:1779690591.354428:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795584 00000100:00100000:2.0:1779690591.354503:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1079 00000100:00100000:2.0:1779690591.354512:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:111653:x1866137503795584:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.354530:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.354546:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140180 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee377 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354612:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354626:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354637:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.354668:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x29:0x0]: returning size 0 00000004:00200000:2.0:1779690591.354673:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690591.354701:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354727:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140180 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee377 expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354742:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee377 expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.354750:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690591.354753:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1779690591.354757:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690591.354835:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+61:111653:x1866137503795584:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 293us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.354841:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1079 00000100:00100000:1.0:1779690591.357126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.357668:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795712 00000100:00100000:0.0:1779690591.357689:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795712 00000100:00100000:0.0:1779690591.357736:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6491 00000100:00100000:0.0:1779690591.357744:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503795712:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690591.357761:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690591.357779:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee37e expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690591.357802:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1779690591.357969:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.357971:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.357979:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 13 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.357996:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 13 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.358014:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34fc00, rc 0) 00000100:00100000:0.0:1779690591.358390:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503795712:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 645us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690591.358397:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6491 00000100:00100000:3.0:1779690591.361764:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.362112:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503795968 00000100:00100000:2.0:1779690591.362121:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503795968 00000100:00100000:2.0:1779690591.362219:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1080 00000100:00100000:2.0:1779690591.362230:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+61:111653:x1866137503795968:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690591.362334:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+61:111653:x1866137503795968:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 107us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.362342:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1080 00000100:00100000:3.0:1779690591.370179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.370243:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796096 00000100:00100000:1.0:1779690591.370252:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796096 00000100:00100000:1.0:1779690591.370297:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6492 00000100:00100000:1.0:1779690591.370308:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:111653:x1866137503796096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690591.370324:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.370342:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee385 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.370371:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.370380:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690591.370382:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690591.370385:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.370425:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.370494:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.370509:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492361856:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690591.370595:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308bf26780 going to sleep for 11 seconds 00000100:00100000:2.0:1779690591.373326:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1866137492361856:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690591.373358:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.373377:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:2.0:1779690591.373444:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+14:111653:x1866137503796096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3138us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.373453:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6492 00000100:00100000:3.0:1779690591.374788:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.375010:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796224 00000100:00100000:1.0:1779690591.375017:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796224 00010000:00010000:1.0:1779690591.375054:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.375086:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3318 00000100:00100000:1.0:1779690591.375095:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+14:2392:x1866137503796224:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690591.375107:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690591.375125:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.375136:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.375157:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed12e9/0xb4bb873a1914018e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee37e expref: 14 pid: 40949 timeout: 3418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.375181:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690591.375183:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690591.375189:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.375198:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.375232:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.375244:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5779:1866137492361984:192.168.203.5@tcp:105: 00000100:00100000:1.0:1779690591.375313:0:5779:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e308bf26780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.383992:0:5779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5779:1866137492361984:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690591.384020:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690591.384089:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503796224:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 8993us (9302us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.384100:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3318 00000100:00100000:0.0:1779690591.395655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.395771:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796352 00000100:00100000:2.0:1779690591.395780:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796352 00002000:00100000:2.0:1779690591.395853:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1f1:0x0] (0->1048575) req@ffff9e308678ed80 x1866137503796352/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:72/0 lens 488/0 e 0 to 0 dl 1779690602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690591.395864:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678ed80 with x1866137503796352 ext(0->1048575) 00002000:00010000:2.0:1779690591.395869:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e308678ed80 00000100:00100000:2.0:1779690591.396006:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2086 00000100:00100000:2.0:1779690591.396017:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503796352:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1779690591.411774:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503796352:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 15751us (16117us total) trans 4294968451 rc 0/0 00000100:00100000:2.0:1779690591.411784:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2086 00002000:00100000:2.0:1779690591.411795:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1f1:0x0] (0->1048575) req@ffff9e308678ed80 x1866137503796352/t4294968451(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:72/0 lens 488/448 e 0 to 0 dl 1779690602 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690591.411849:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e308678ed80 with x1866137503796352 ext(0->1048575) 00002000:00010000:2.0:1779690591.411857:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e308678ed80 00000100:00100000:0.0:1779690591.418102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.418259:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796480 00000100:00100000:1.0:1779690591.418270:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796480 00000100:00100000:1.0:1779690591.418327:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1081 00000100:00100000:1.0:1779690591.418338:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+61:111653:x1866137503796480:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1779690591.451681:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+61:111653:x1866137503796480:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 33337us (33580us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.451708:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1081 00000001:00080000:3.0:1779690591.451952:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902359 is committed 00000020:00080000:3.0:1779690591.451979:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018968 batchid updated 00000001:00080000:3.0:1779690591.452003:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902354 is committed 00000001:00080000:3.0:1779690591.452009:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902360 is committed 00000020:00080000:0.0:1779690591.452055:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018968 00000020:00080000:0.0:1779690591.452067:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018968 00000100:00100000:3.0:1779690591.453841:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.453933:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796608 00000100:00100000:1.0:1779690591.453940:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796608 00000100:00100000:1.0:1779690591.453995:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6493 00000100:00100000:1.0:1779690591.454005:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503796608:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1779690591.482593:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968451 is committed 00000001:00080000:0.0:1779690591.482615:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968450 is committed 00000100:00100000:2.0:1779690591.482755:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503796608:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 28745us (28950us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.482766:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6493 00000100:00100000:0.0:1779690591.487056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.487168:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796864 00000100:00100000:2.0:1779690591.487176:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796864 00000100:00100000:2.0:1779690591.487236:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1082 00000100:00100000:2.0:1779690591.487245:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503796864:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.487500:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690591.487530:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140187 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee377 expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.487555:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690591.487560:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690591.487587:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.487601:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.487610:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690591.487794:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002b9e1187 reply state 00000000b132dc01 transno 12884902361 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.487864:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690591.488041:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503796864:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 796us (994us total) trans 12884902361 rc 0/0 00000100:00100000:2.0:1779690591.488050:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1082 00010000:00010000:3.0:1779690591.491736:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.491751:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.491759:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.491765:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.491768:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.491776:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.491791:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690591.491794:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690591.491798:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.492264:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914019c lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.492634:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.492698:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503796992 00000100:00100000:2.0:1779690591.492707:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503796992 00000100:00100000:2.0:1779690591.492759:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1083 00000100:00100000:2.0:1779690591.492768:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503796992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.492790:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.492904:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee38c expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.492971:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.492985:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.493004:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690591.493006:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690591.493009:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690591.493144:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503796992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 377us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.493152:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1083 00000100:00100000:0.0:1779690591.496908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.497003:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503797120 00000100:00100000:3.0:1779690591.497012:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503797120 00000100:00100000:3.0:1779690591.497060:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6494 00000100:00100000:3.0:1779690591.497069:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503797120:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1779690591.497294:0:6582:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1f1:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1779690591.497298:0:6582:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1f1:0x0] updating lvb mtime from disk: 0 -> 1779690588 00002000:00010000:3.0:1779690591.497300:0:6582:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1f1:0x0] updating lvb atime from disk: 0 -> 1779690588 00002000:00010000:3.0:1779690591.497302:0:6582:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1f1:0x0] updating lvb ctime from disk: 0 -> 1779690588 00002000:00010000:3.0:1779690591.497304:0:6582:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1f1:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:3.0:1779690591.497368:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+14:2392:x1866137503797120:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 299us (467us total) trans 4294968452 rc 0/0 00000100:00100000:3.0:1779690591.497375:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6494 00000100:00100000:3.0:1779690591.500505:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.500656:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503797376 00000100:00100000:1.0:1779690591.500664:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503797376 00000100:00100000:1.0:1779690591.500770:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1084 00000100:00100000:1.0:1779690591.500780:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:111653:x1866137503797376:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1779690591.500882:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.500900:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.500910:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.500940:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 56 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.500954:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 56 pid: 57560 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.500968:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492362112:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690591.501046:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.503768:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.503863:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503797504 00000100:00100000:3.0:1779690591.503871:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503797504 00010000:00010000:3.0:1779690591.503906:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 57 pid: 57560 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690591.503955:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3319 00000100:00100000:3.0:1779690591.503965:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503797504:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690591.503980:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690591.503986:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 57 pid: 57560 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.503998:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 57 pid: 57560 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.504032:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690591.504036:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.504045:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.504053:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.504071:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690591.504137:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503797504:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 173us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.504145:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3319 00010000:00010000:2.0:1779690591.504890:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140156 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee362 expref: 56 pid: 57560 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.504906:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc82680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492362112:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690591.504934:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.504943:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.504948:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.504974:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.504987:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.504994:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.505000:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.505004:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.505010:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.505021:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690591.505024:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690591.505028:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.505034:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a191401aa lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.505084:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503797376:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 4306us (4586us total) trans 0 rc -22/-22 00000100:00100000:2.0:1779690591.505093:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1084 00000100:00100000:1.0:1779690591.506710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.507005:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503797632 00000100:00100000:3.0:1779690591.507023:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503797632 00000100:00100000:3.0:1779690591.507069:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6495 00000100:00100000:3.0:1779690591.507078:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+14:2391:x1866137503797632:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690591.507117:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.507138:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.507146:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690591.507148:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1779690591.507151:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.507206:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.507220:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 14 pid: 6581 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690591.507234:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492362240:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690591.507509:0:6583:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089b47840 going to sleep for 11 seconds 00000100:00100000:3.0:1779690591.510985:0:6583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1866137492362240:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690591.511012:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.514100:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.514320:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503797760 00000100:00100000:3.0:1779690591.514329:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503797760 00010000:00010000:3.0:1779690591.514363:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 15 pid: 6581 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690591.514405:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3320 00000100:00100000:3.0:1779690591.514414:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+15:2392:x1866137503797760:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690591.514427:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690591.514449:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 15 pid: 6581 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.514480:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 15 pid: 6581 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.514504:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11b637d/0xb4bb873a19140195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee385 expref: 15 pid: 6581 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.514520:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690591.514522:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690591.514527:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.514536:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.514572:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690591.514633:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+14:2392:x1866137503797760:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 220us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.514640:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3320 00010000:00010000:1.0:1779690591.514768:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514778:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514800:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514852:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514861:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514868:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690591.514872:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514880:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514890:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.514908:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2a12b9/0xb4bb873a191401b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.514949:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503797632:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 7872us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.514956:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6495 00000100:00100000:0.0:1779690591.517177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.517324:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798016 00000100:00100000:2.0:1779690591.517332:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798016 00000100:00100000:2.0:1779690591.517411:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1085 00000100:00100000:2.0:1779690591.517422:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+55:111653:x1866137503798016:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1779690591.517491:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517518:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517529:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517745:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517756:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517764:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517794:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 56 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.517841:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 56 pid: 57561 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.517856:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492362368:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690591.517950:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690591.519897:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492362368:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690591.519938:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.520851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.520880:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798144 00000100:00100000:1.0:1779690591.520887:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798144 00010000:00010000:1.0:1779690591.520921:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 57 pid: 57561 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.520952:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3321 00000100:00100000:1.0:1779690591.520959:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503798144:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690591.520972:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690591.520977:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 57 pid: 57561 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.520989:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 57 pid: 57561 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.521009:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a191401a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee38c expref: 57 pid: 57561 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.521022:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:1.0:1779690591.521085:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.521108:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.521116:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.521143:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690591.521174:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.521184:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.521191:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+56:2392:x1866137503798144:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 230us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.521201:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3321 00000001:00080000:2.0:1779690591.521376:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902362 00000001:00080000:2.0:1779690591.521524:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902363 00000001:00080000:2.0:1779690591.521574:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902364 00000100:00100000:2.0:1779690591.521759:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:57560:1866137492362496:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1779690591.521800:0:57560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690591.521860:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.522262:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492362496 00000100:00100000:1.0:1779690591.522267:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492362496 00000100:00100000:1.0:1779690591.522302:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1779690591.522308:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57560:x1866137492362496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1779690591.522387:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57560:x1866137492362496:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.522394:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00100000:0.0:1779690591.522428:0:57560:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968450 gen 2 00000004:00080000:0.0:1779690591.522434:0:57560:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e308678ce00, transno 4294968450 00000100:00100000:0.0:1779690591.522454:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:57560:1866137492362496:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1779690591.523866:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902365 00000100:00100000:0.0:1779690591.524013:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:57560:1866137492362624:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1779690591.524048:0:57560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690591.524097:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30847e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690591.524135:0:40691:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492362624 00000100:00100000:2.0:1779690591.524139:0:40691:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492362624 00000100:00100000:2.0:1779690591.524169:0:40691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3461 00000100:00100000:2.0:1779690591.524174:0:40691:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57560:x1866137492362624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1779690591.524515:0:40691:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57560:x1866137492362624:12345-0@lo:1000:mdt00_001.0 Request processed in 340us (465us total) trans 4294968453 rc 0/0 00000100:00100000:2.0:1779690591.524523:0:40691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3461 00000100:00100000:0.0:1779690591.524664:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:57560:1866137492362624:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1779690591.524742:0:57560:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902366 00010000:00010000:0.0:1779690591.524768:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.524778:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.524786:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.524792:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690591.524796:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.524912:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.524989:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:0.0:1779690591.525001:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690591.525006:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525013:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191401bf lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525042:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525049:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525055:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525060:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690591.525063:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525069:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525077:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:0.0:1779690591.525079:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690591.525085:0:57560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525094:0:57560:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525103:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.525135:0:57560:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 53 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.525147:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d923100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492362752:192.168.203.5@tcp:105: 00000100:00100000:0.0:1779690591.525331:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30847e40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690591.528100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.528323:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798272 00000100:00100000:3.0:1779690591.528331:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798272 00000100:00100000:3.0:1779690591.528382:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 142 00000100:00100000:3.0:1779690591.528400:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503798272:12345-192.168.203.5@tcp:49:cp.0 00000100:00100000:3.0:1779690591.528537:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503798272:12345-192.168.203.5@tcp:49:cp.0 Request processed in 146us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.528544:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 142 00000100:00100000:2.0:1779690591.528913:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d923100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492362752:192.168.203.5@tcp:105: 00010000:00010000:2.0:1779690591.529022:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529033:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191400d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529061:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529075:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529083:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529102:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529108:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529115:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529120:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.529124:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529130:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529141:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:2.0:1779690591.529143:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690591.529147:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529152:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e000/0xb4bb873a191401c6 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529161:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529167:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529173:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529185:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.529188:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529194:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529202:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:2.0:1779690591.529204:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690591.529207:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.529213:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191401b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.529488:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+60:111653:x1866137503798016:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 12067us (12315us total) trans 12884902367 rc 0/0 00000100:00100000:2.0:1779690591.529496:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1085 00000020:00080000:2.0:1779690591.529500:0:57560:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1779690591.529627:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690591.529631:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690591.530350:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:0.0:1779690591.530359:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690591.533026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.533169:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798528 00000100:00100000:3.0:1779690591.533179:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798528 00000100:00100000:3.0:1779690591.533228:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:3.0:1779690591.533236:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+60:111653:x1866137503798528:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1779690591.534678:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1779690591.534796:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902368 00010000:00010000:2.0:1779690591.534944:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.534961:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.534972:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.534981:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.534995:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.535002:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.535025:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690591.535121:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+62:111653:x1866137503798528:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1882us (2100us total) trans 12884902369 rc 0/0 00000100:00100000:2.0:1779690591.535130:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 143 00000020:00080000:2.0:1779690591.535136:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690591.536025:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690591.536030:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.536037:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4b000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690591.536040:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.536046:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.536103:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x29:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:3.0:1779690591.536105:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690591.536109:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.536113:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a191401cd lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.536137:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690591.536148:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690591.536158:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690591.536433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.536477:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798656 00000100:00100000:0.0:1779690591.536486:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798656 00000100:00100000:0.0:1779690591.536540:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6496 00000100:00100000:0.0:1779690591.536550:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+8:111652:x1866137503798656:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:0.0:1779690591.536566:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690591.536582:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee393 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690591.536605:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f1:0x0] initial LVB size: 1048576, mtime: 0x6a13ec5c, atime: 0x6a13ec5c, ctime: 0x6a13ec5c, blocks: 0x803 00010000:00010000:0.0:1779690591.536620:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.536623:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.536630:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 9 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.536645:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 9 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.536669:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8a34f200, rc 0) 00000100:00100000:0.0:1779690591.536714:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+9:111652:x1866137503798656:12345-192.168.203.5@tcp:101:cp.0 Request processed in 166us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690591.536721:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6496 00000100:00100000:0.0:1779690591.547992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.548111:0:6587:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798784 00000100:00100000:1.0:1779690591.548118:0:6587:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798784 00002000:00100000:1.0:1779690591.548156:0:6587:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f1:0x0] (0->1048575) req@ffff9e2f8d923b80 x1866137503798784/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:72/0 lens 488/0 e 0 to 0 dl 1779690602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690591.548163:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d923b80 with x1866137503798784 ext(0->1048575) 00002000:00010000:1.0:1779690591.548168:0:6587:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8d923b80 00000100:00100000:1.0:1779690591.548192:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2087 00000100:00100000:1.0:1779690591.548198:0:6587:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503798784:12345-192.168.203.5@tcp:3:cp.0 00000100:00100000:1.0:1779690591.562433:0:6587:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503798784:12345-192.168.203.5@tcp:3:cp.0 Request processed in 14225us (14438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1779690591.562445:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2087 00002000:00100000:1.0:1779690591.562457:0:6587:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f1:0x0] (0->1048575) req@ffff9e2f8d923b80 x1866137503798784/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:72/0 lens 488/440 e 0 to 0 dl 1779690602 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690591.562467:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d923b80 with x1866137503798784 ext(0->1048575) 00002000:00010000:1.0:1779690591.562473:0:6587:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8d923b80 00000100:00100000:3.0:1779690591.568615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.568684:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503798912 00000100:00100000:2.0:1779690591.568694:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503798912 00000100:00100000:2.0:1779690591.568774:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6497 00000100:00100000:2.0:1779690591.568784:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+18:111652:x1866137503798912:12345-192.168.203.5@tcp:101:cp.0 00010000:00010000:2.0:1779690591.568801:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.568867:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee39a expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.568899:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.568909:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.568911:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.568915:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.568947:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.568972:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 3419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.568987:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492362880:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690591.569094:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7e40 going to sleep for 11 seconds 00000100:00080000:3.0:1779690591.569706:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690591.570761:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492362880:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690591.570798:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.570887:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e000, rc 0) 00000100:00100000:2.0:1779690591.570979:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:111652:x1866137503798912:12345-192.168.203.5@tcp:101:cp.0 Request processed in 2196us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.570987:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6497 00000100:00100000:1.0:1779690591.573317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.573380:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503799040 00000100:00100000:2.0:1779690591.573388:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503799040 00010000:00010000:2.0:1779690591.573424:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 3419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.573464:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3322 00000100:00100000:2.0:1779690591.573474:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503799040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690591.573489:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690591.573511:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 3419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.573544:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 3419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.573567:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070612cee/0xb4bb873a191400ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee338 expref: 19 pid: 49882 timeout: 3419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.573582:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.573584:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.573589:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.573609:0:17231:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.573643:0:17231:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.573656:0:17231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17231:1866137492363008:192.168.203.5@tcp:105: 00000100:00100000:2.0:1779690591.573734:0:17231:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690591.575890:0:17231:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17231:1866137492363008:192.168.203.5@tcp:105: 00010000:00010000:2.0:1779690591.575935:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690591.575984:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503799040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2511us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.575994:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3322 00000100:00100000:0.0:1779690591.589784:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.589933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.590066:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503799424 00000100:00100000:2.0:1779690591.590074:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503799424 00000100:00100000:2.0:1779690591.590123:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 144 00000100:00100000:2.0:1779690591.590134:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+54:111652:x1866137503799424:12345-192.168.203.5@tcp:35:cp.0 00000001:00080000:2.0:1779690591.590429:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902370 00000100:00100000:2.0:1779690591.590541:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:111652:x1866137503799424:12345-192.168.203.5@tcp:35:cp.0 Request processed in 408us (606us total) trans 12884902371 rc 0/0 00000100:00100000:2.0:1779690591.590549:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 144 00000020:00080000:2.0:1779690591.590554:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1779690591.590716:0:17861:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503799168 00000100:00100000:1.0:1779690591.590721:0:17861:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503799168 00002000:00100000:1.0:1779690591.590749:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1f1:0x0] (0->1048575) req@ffff9e2f8d920380 x1866137503799168/t0(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:72/0 lens 488/0 e 0 to 0 dl 1779690602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690591.590759:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d920380 with x1866137503799168 ext(0->1048575) 00002000:00010000:1.0:1779690591.590765:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8d920380 00000100:00100000:1.0:1779690591.590876:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2088 00000100:00100000:1.0:1779690591.590885:0:17861:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e775ff0e-5641-488a-99d7-1331a4992115+18:2391:x1866137503799168:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:3.0:1779690591.594933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.595196:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503799680 00000100:00100000:2.0:1779690591.595205:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503799680 00000100:00100000:2.0:1779690591.595255:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:2.0:1779690591.595269:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:111652:x1866137503799680:12345-192.168.203.5@tcp:35:cp.0 00000100:00100000:2.0:1779690591.595930:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+57:111652:x1866137503799680:12345-192.168.203.5@tcp:35:cp.0 Request processed in 666us (1002us total) trans 12884902372 rc 0/0 00000100:00100000:2.0:1779690591.595940:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:0.0:1779690591.611682:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.611865:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503799808 00000100:00100000:1.0:1779690591.611874:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503799808 00000100:00100000:1.0:1779690591.611932:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1086 00000100:00100000:1.0:1779690591.611944:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+57:111654:x1866137503799808:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:1.0:1779690591.611979:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.612128:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a191401e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3a1 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612323:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612347:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612433:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690591.612707:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690591.612711:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690591.612842:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612867:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a191401e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a1 expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612884:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a1 expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.612892:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442600) 00010000:00010000:1.0:1779690591.612895:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690591.612898:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:1.0:1779690591.612950:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:111654:x1866137503799808:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 1010us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.612957:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1086 00000100:00100000:1.0:1779690591.615861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.616198:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503800064 00000100:00100000:3.0:1779690591.616208:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503800064 00000100:00100000:3.0:1779690591.616260:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1087 00000100:00100000:3.0:1779690591.616270:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:111654:x1866137503800064:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:3.0:1779690591.616287:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690591.616306:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a191401f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3a8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616373:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616388:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616400:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616416:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616423:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616430:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616934:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616950:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.616958:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690591.616968:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:3.0:1779690591.617070:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617078:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617084:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617090:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4aa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.617094:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617102:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617116:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442600) 00010000:00010000:3.0:1779690591.617119:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690591.617123:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617129:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191401f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617152:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617159:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617164:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617170:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.617173:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617179:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617188:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f905adb00) 00010000:00010000:3.0:1779690591.617190:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690591.617194:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617200:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191401fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617248:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a191401f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617264:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.617283:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:3.0:1779690591.617286:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690591.617289:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b000, rc 0) 00000100:00100000:3.0:1779690591.617345:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+60:111654:x1866137503800064:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 1076us (1492us total) trans 12884902373 rc 0/0 00000100:00100000:3.0:1779690591.617355:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1087 00000100:00100000:2.0:1779690591.621382:0:17861:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e775ff0e-5641-488a-99d7-1331a4992115+20:2391:x1866137503799168:12345-192.168.203.5@tcp:4:cp.0 Request processed in 30490us (31597us total) trans 4294968352 rc 0/0 00000100:00100000:2.0:1779690591.621395:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2088 00002000:00100000:2.0:1779690591.621407:0:17861:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1f1:0x0] (0->1048575) req@ffff9e2f8d920380 x1866137503799168/t4294968352(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:72/0 lens 488/448 e 0 to 0 dl 1779690602 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690591.621418:0:17861:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8d920380 with x1866137503799168 ext(0->1048575) 00002000:00010000:2.0:1779690591.621423:0:17861:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f8d920380 00000100:00100000:1.0:1779690591.622308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.622372:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503800320 00000100:00100000:2.0:1779690591.622379:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503800320 00000100:00100000:2.0:1779690591.622427:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1088 00000100:00100000:2.0:1779690591.622456:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+60:111654:x1866137503800320:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:2.0:1779690591.622487:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.622506:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3af expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.622590:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1914021a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.622604:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1914021a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x90:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.622615:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1914021a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x90:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.622626:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x90:0x0]: returning size 1048576 00010000:00010000:2.0:1779690591.622738:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3af expref: 63 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.622755:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1914021a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x90:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3af expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.622774:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x90:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:2.0:1779690591.622777:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1779690591.622780:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4ec00, rc 0) 00000100:00100000:2.0:1779690591.622854:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+62:111654:x1866137503800320:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 401us (548us total) trans 12884902374 rc 0/0 00000100:00100000:2.0:1779690591.622861:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1088 00000100:00100000:0.0:1779690591.635488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.635563:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503800576 00000100:00100000:3.0:1779690591.635571:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503800576 00000100:00100000:3.0:1779690591.635623:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:3.0:1779690591.635632:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+62:111654:x1866137503800576:12345-192.168.203.5@tcp:35:cmp.0 00000100:00100000:3.0:1779690591.635888:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+63:111654:x1866137503800576:12345-192.168.203.5@tcp:35:cmp.0 Request processed in 256us (407us total) trans 12884902375 rc 0/0 00000100:00100000:3.0:1779690591.635895:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:3.0:1779690591.659657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.659751:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503800832 00000100:00100000:0.0:1779690591.659760:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503800832 00000100:00100000:0.0:1779690591.659846:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1089 00000100:00100000:0.0:1779690591.659857:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+63:111655:x1866137503800832:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690591.659892:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690591.659912:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140228 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3b6 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.660018:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.660035:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.660045:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690591.660058:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:0.0:1779690591.663497:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140228 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3b6 expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.663522:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3b6 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.663531:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:0.0:1779690591.663534:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1779690591.663537:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690591.663612:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+65:111655:x1866137503800832:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3756us (3961us total) trans 12884902376 rc 0/0 00000100:00100000:0.0:1779690591.663621:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1089 00000100:00100000:1.0:1779690591.665989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.666118:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503800960 00000100:00100000:2.0:1779690591.666128:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503800960 00000100:00100000:2.0:1779690591.666190:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6498 00000100:00100000:2.0:1779690591.666201:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503800960:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:2.0:1779690591.666242:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.666263:0:22279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 9 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.666281:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.666283:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690591.666286:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.666319:0:22279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 9 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.666332:0:22279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 9 pid: 40949 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.666347:0:22279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492363136:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690591.666483:0:22279:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.673035:0:22279:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22279:1866137492363136:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690591.673418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.673736:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801088 00000100:00100000:0.0:1779690591.673743:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801088 00010000:00010000:0.0:1779690591.673780:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 10 pid: 40949 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690591.673867:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3323 00000100:00100000:0.0:1779690591.673877:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503801088:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690591.673891:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690591.673912:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 10 pid: 40949 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.673925:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 10 pid: 40949 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.673947:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c0a0dec/0xb4bb873a191401d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee393 expref: 10 pid: 40949 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.673971:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.673973:0:7464:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690591.673977:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.673986:0:7464:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.674005:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690591.674049:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503801088:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 173us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690591.674066:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3323 00010000:00010000:1.0:1779690591.677800:0:22279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.677854:0:22279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.677862:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.677895:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.677904:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.678141:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.678151:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690591.678156:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.678164:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.678181:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.678199:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e8941ec/0xb4bb873a1914023d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.678377:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+8:2392:x1866137503800960:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 12175us (12392us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.678385:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6498 00000100:00100000:3.0:1779690591.680454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.682129:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801344 00000100:00100000:2.0:1779690591.682140:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801344 00000100:00100000:2.0:1779690591.682271:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:2.0:1779690591.682283:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:111655:x1866137503801344:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1779690591.682351:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x28:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3b6 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1779690591.682606:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902377 00000001:00080000:2.0:1779690591.683191:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902378 00010000:00010000:2.0:1779690591.683251:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683266:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683276:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 68 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683285:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683318:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 68 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683332:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 68 pid: 57559 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.683348:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492363264:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690591.683443:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.683453:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.683475:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492363392:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690591.683501:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7300 going to sleep for 11 seconds 00000100:00100000:2.0:1779690591.688765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.688884:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801472 00000100:00100000:1.0:1779690591.688894:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801472 00010000:00010000:1.0:1779690591.689006:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 69 pid: 57559 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690591.689038:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3324 00000100:00100000:1.0:1779690591.689046:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+69:2391:x1866137503801472:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690591.689071:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690591.689078:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 69 pid: 57559 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.689088:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 69 pid: 57559 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.689108:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:1.0:1779690591.689113:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.689120:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.689137:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690591.689181:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+69:2391:x1866137503801472:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 135us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.689188:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3324 00010000:00010000:1.0:1779690591.689207:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690591.690425:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140205 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a8 expref: 68 pid: 57559 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690591.690441:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492363264:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690591.690739:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.690796:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801600 00000100:00100000:2.0:1779690591.690803:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801600 00010000:00010000:2.0:1779690591.690853:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.690880:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3325 00000100:00100000:2.0:1779690591.690888:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503801600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690591.690899:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690591.690904:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.690915:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 68 pid: 57585 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.690931:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:2.0:1779690591.690935:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.690943:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.690951:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.690994:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690591.691038:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503801600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 150us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.691045:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3325 00010000:00010000:2.0:1779690591.691225:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a191400df lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee33f expref: 67 pid: 57585 timeout: 3419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.691240:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492363392:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690591.691271:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.691280:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.691285:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1779690591.691396:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902379 00000001:00080000:2.0:1779690591.691851:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902380 00000001:00080000:2.0:1779690591.691907:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902381 00000100:00100000:2.0:1779690591.691986:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492363520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690591.692029:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690591.692172:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.694366:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492363520 00000100:00100000:1.0:1779690591.694377:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492363520 00000100:00100000:1.0:1779690591.694434:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3462 00000100:00100000:1.0:1779690591.694443:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492363520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1779690591.694728:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492363520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 286us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.694735:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3462 00000100:00100000:2.0:1779690591.695140:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492363520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1779690591.695614:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902382 00000100:00100000:2.0:1779690591.695687:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492363648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1779690591.695730:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690591.695758:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7300 going to sleep for 11 seconds 00000100:00100000:1.0:1779690591.696156:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492363648 00000100:00100000:1.0:1779690591.696161:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492363648 00000100:00100000:1.0:1779690591.696198:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3463 00000100:00100000:1.0:1779690591.696206:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57563:x1866137492363648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1779690591.696369:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57563:x1866137492363648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (637us total) trans 4294968454 rc 0/0 00000100:00100000:1.0:1779690591.696377:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3463 00000100:00100000:3.0:1779690591.697197:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492363648:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:3.0:1779690591.697227:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697250:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697258:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697263:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.697267:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697275:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697290:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:3.0:1779690591.697293:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1779690591.697297:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.697303:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140244 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690591.697558:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x91:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1779690591.697650:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].11, 64 off8968 00000004:00080000:3.0:1779690591.697661:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3319271854706ns, next at 3320271853047ns, rc = 0 00000001:00080000:3.0:1779690591.697668:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902383 00010000:00010000:3.0:1779690591.697710:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226b00) 00010000:00010000:3.0:1779690591.697714:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690591.697720:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914022f lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3b6 expref: 71 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690591.697849:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+70:111655:x1866137503801344:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 15568us (17398us total) trans 12884902384 rc 0/0 00000100:00100000:3.0:1779690591.697858:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 147 00000020:00080000:3.0:1779690591.697862:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1779690591.722030:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.722515:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801856 00000100:00100000:3.0:1779690591.722525:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801856 00000100:00100000:3.0:1779690591.722582:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1090 00000100:00100000:3.0:1779690591.722592:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+70:111658:x1866137503801856:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690591.722615:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690591.722634:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a1914024b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3bd expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722699:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722712:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722722:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722734:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722740:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.722746:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724186:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140260 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724200:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724210:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690591.724221:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:3.0:1779690591.724309:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724317:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724323:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724328:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ae00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.724332:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724338:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724348:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442600) 00010000:00010000:3.0:1779690591.724351:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690591.724355:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724373:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724386:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724393:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724398:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724403:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690591.724406:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724412:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.724420:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f905adb00) 00010000:00010000:3.0:1779690591.724422:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690591.725257:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.725266:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.726437:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a1914024b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3bd expref: 73 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.726456:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3bd expref: 72 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.726465:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:0.0:1779690591.726467:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690591.726470:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4aa00, rc 0) 00000100:00100000:0.0:1779690591.726604:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+72:111658:x1866137503801856:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 4012us (4580us total) trans 12884902385 rc 0/0 00000100:00100000:0.0:1779690591.726613:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1090 00000100:00100000:1.0:1779690591.731499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.731593:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503801984 00000100:00100000:2.0:1779690591.731602:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503801984 00000100:00100000:2.0:1779690591.731658:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1091 00000100:00100000:2.0:1779690591.731668:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+72:111658:x1866137503801984:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1779690591.731726:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731743:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731754:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731777:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731783:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731789:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731795:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690591.731799:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731847:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731858:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:2.0:1779690591.731861:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690591.731872:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.731878:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914026e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690591.731942:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+72:111658:x1866137503801984:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 275us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.731949:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1091 00000100:00100000:1.0:1779690591.734510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.734597:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503802240 00000100:00100000:3.0:1779690591.734605:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503802240 00000100:00100000:3.0:1779690591.734678:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:3.0:1779690591.734687:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+72:111658:x1866137503802240:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1779690591.734957:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+73:111658:x1866137503802240:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 270us (452us total) trans 12884902386 rc 0/0 00000100:00100000:3.0:1779690591.734965:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:3.0:1779690591.767512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.767555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690591.768997:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503802368 00000100:00100000:0.0:1779690591.769008:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503802368 00000100:00100000:0.0:1779690591.769071:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503802624 00000100:00100000:0.0:1779690591.769075:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503802624 00000100:00100000:0.0:1779690591.769108:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1092 00000100:00100000:0.0:1779690591.769118:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+74:2389:x1866137503802368:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:0.0:1779690591.769165:0:64445:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257846272 avail 2255749120 00000100:00100000:0.0:1779690591.769230:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+74:2389:x1866137503802368:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 113us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690591.769237:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1092 00000100:00100000:0.0:1779690591.769253:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1093 00000100:00100000:0.0:1779690591.769260:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+73:111663:x1866137503802624:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:0.0:1779690591.769297:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690591.769322:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a191401e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3a1 expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690591.769344:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442600) 00010000:00010000:0.0:1779690591.769354:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690591.769960:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+72:111663:x1866137503802624:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 698us (2402us total) trans 0 rc -17/-17 00000100:00100000:0.0:1779690591.769967:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1093 00000100:00100000:0.0:1779690591.771558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.771855:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503802752 00000100:00100000:2.0:1779690591.771863:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503802752 00000100:00100000:2.0:1779690591.771910:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1094 00000100:00100000:2.0:1779690591.771919:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+72:111663:x1866137503802752:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690591.771935:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.771954:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3c4 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772021:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772035:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772047:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.772208:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690591.772212:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690591.772286:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772318:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 74 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772332:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 73 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.772340:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690591.772343:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690591.772346:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690591.772404:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+73:111663:x1866137503802752:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 486us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690591.772411:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1094 00000100:00100000:3.0:1779690591.778444:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.778567:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503802880 00000100:00100000:1.0:1779690591.778577:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503802880 00000100:00100000:1.0:1779690591.778631:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1095 00000100:00100000:1.0:1779690591.778653:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+73:111663:x1866137503802880:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690591.778672:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.778691:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3cb expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778750:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778765:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778776:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778791:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778798:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.778836:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779104:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779113:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779120:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690591.779218:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8e:0x0]: returning size 7680 00000004:00200000:1.0:1779690591.779222:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690591.779306:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779318:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779324:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779330:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779335:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690591.779339:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779347:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779358:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690591.779361:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690591.779365:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779371:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a1914028a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779384:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779399:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779405:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779409:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690591.779412:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779418:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779425:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (ffff9e2f90442c00) 00010000:00010000:1.0:1779690591.779428:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690591.779430:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779436:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140291 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779465:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3cb expref: 75 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779479:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3cb expref: 74 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.779486:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:1.0:1779690591.779489:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690591.779497:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53ee00, rc 0) 00000100:00100000:1.0:1779690591.779562:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+74:111663:x1866137503802880:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 910us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.779569:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1095 00000100:00100000:0.0:1779690591.809624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690591.810367:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803136 00000100:00100000:2.0:1779690591.810376:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803136 00000100:00100000:2.0:1779690591.810433:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1096 00000100:00100000:2.0:1779690591.810442:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:111664:x1866137503803136:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:2.0:1779690591.810461:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690591.810480:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914029f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3d2 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.810568:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.810582:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.810593:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690591.810615:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690591.810762:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a1914029f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d2 expref: 77 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.810781:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d2 expref: 76 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690591.810789:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:2.0:1779690591.810792:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1779690591.810795:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f200, rc 0) 00000100:00100000:2.0:1779690591.811001:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+76:111664:x1866137503803136:12345-192.168.203.5@tcp:101:tar.0 Request processed in 558us (1384us total) trans 12884902387 rc 0/0 00000100:00100000:2.0:1779690591.811009:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1096 00000100:00100000:3.0:1779690591.818373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.818843:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803392 00000100:00100000:1.0:1779690591.818852:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803392 00000100:00100000:1.0:1779690591.818917:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18685 00000100:00100000:1.0:1779690591.818927:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+76:111664:x1866137503803392:12345-192.168.203.5@tcp:103:tar.0 00010000:00010000:1.0:1779690591.818941:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1779690591.818962:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d2 expref: 76 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.818979:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140260 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3bd expref: 75 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.818992:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905add00) 00010000:00010000:1.0:1779690591.819004:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690591.819114:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+74:111664:x1866137503803392:12345-192.168.203.5@tcp:103:tar.0 Request processed in 188us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.819121:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18685 00000100:00100000:2.0:1779690591.822539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690591.822650:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803520 00000100:00100000:3.0:1779690591.822659:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803520 00000100:00100000:3.0:1779690591.822707:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1097 00000100:00100000:3.0:1779690591.822717:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+74:111664:x1866137503803520:12345-192.168.203.5@tcp:58:tar.0 00010000:00010000:3.0:1779690591.822835:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.822852:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690591.822864:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1779690591.823139:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].43, 136 off14040 00000100:00100000:3.0:1779690591.823208:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+74:111664:x1866137503803520:12345-192.168.203.5@tcp:58:tar.0 Request processed in 492us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690591.823216:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1097 00000100:00100000:0.0:1779690591.827470:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690591.827606:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803648 00000100:00100000:1.0:1779690591.827627:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803648 00000100:00100000:1.0:1779690591.827692:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1098 00000100:00100000:1.0:1779690591.827702:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+74:111664:x1866137503803648:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:1.0:1779690591.827721:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690591.827740:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3d9 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827870:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827886:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 4/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 75 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827905:0:64445:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827917:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 75 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827929:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:1.0:1779690591.827933:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690591.827936:0:64445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 3/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 75 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690591.827943:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bf53e400, rc 0) 00000100:00100000:1.0:1779690591.828002:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+75:111664:x1866137503803648:12345-192.168.203.5@tcp:101:tar.0 Request processed in 301us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690591.828009:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1098 00000100:00100000:0.0:1779690592.201031:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492363904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690592.201064:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492364032:0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.201095:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492363776:0@lo:400:kworker.0 00000100:00100000:0.0:1779690592.201104:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690592.201110:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690592.201204:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492363904 00000100:00100000:1.0:1779690592.201222:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492363904 00000100:00100000:1.0:1779690592.201274:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1779690592.201282:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1866137492363904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690592.201302:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 621084672 pending 0 free 3760193536 avail 3757047808 00000100:00100000:2.0:1779690592.205653:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690592.205722:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492364288:0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.205761:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690592.205789:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690592.205795:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492364416:0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.205843:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690592.205882:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492363776 00000100:00100000:2.0:1779690592.205890:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492363776 00000100:00100000:2.0:1779690592.205936:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1779690592.205945:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492363776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.206178:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492363776:12345-0@lo:400:kworker.0 Request processed in 233us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.206185:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1779690592.206220:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492364288 00000100:00100000:2.0:1779690592.206223:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492364288 00000100:00100000:2.0:1779690592.206255:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1779690592.206261:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492364288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.206292:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492364288:12345-0@lo:400:kworker.0 Request processed in 32us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.206298:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1779690592.206334:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492363776:0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.206349:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492364288:0@lo:400:kworker.0 00000100:00100000:3.0:1779690592.206380:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492364544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690592.206381:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492364032 00000100:00100000:2.0:1779690592.206386:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492364032 00000100:00100000:2.0:1779690592.206414:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492364416 00000100:00100000:3.0:1779690592.206421:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690592.206442:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690592.206448:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492364160:0@lo:400:kworker.0 00000100:00100000:3.0:1779690592.206468:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690592.206497:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492364544 00000100:00100000:3.0:1779690592.206500:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492364544 00000100:00100000:3.0:1779690592.206520:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1779690592.206526:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492364544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690592.206541:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 746127360 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690592.206574:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492364544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.206580:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1779690592.206587:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492364416 00000100:00080000:3.0:1779690592.206602:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690592.206607:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690592.206609:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690592.206617:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492364160 00000100:00100000:2.0:1779690592.206620:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492364160 00000100:00080000:3.0:1779690592.206634:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690592.206647:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1779690592.206654:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492364032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690592.206663:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492364544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690592.206688:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1779690592.206696:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492364032:12345-0@lo:400:kworker.0 Request processed in 42us (5589us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.206699:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492364416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.206708:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1779690592.206723:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1779690592.206731:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492364160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690592.206746:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492364416:12345-0@lo:400:kworker.0 Request processed in 50us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.206753:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1779690592.206767:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492364160:12345-0@lo:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.206779:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1779690592.206785:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492364160:0@lo:400:kworker.0 00000100:00100000:3.0:1779690592.206798:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492364032:0@lo:400:kworker.0 00000100:00100000:2.0:1779690592.206844:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492364416:0@lo:400:kworker.0 00000100:00100000:1.0:1779690592.212785:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1866137492363904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11497us (11677us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.212799:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1779690592.212962:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492363904:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1779690592.585049:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690592.585069:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690592.585110:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 44 count 13 00000040:00080000:0.0:1779690592.585117:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690592.585248:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e95180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492364672:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690592.585363:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30847e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690592.596921:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e95180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492364672:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690592.598879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.602405:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803776 00000100:00100000:3.0:1779690592.602435:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803776 00000100:00100000:3.0:1779690592.602635:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1099 00000100:00100000:3.0:1779690592.602646:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503803776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690592.602687:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690592.602789:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503803776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 144us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.602796:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1099 00000100:00080000:0.0:1779690592.602937:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690592.610629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.610700:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503803904 00000100:00100000:2.0:1779690592.610711:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503803904 00000100:00100000:2.0:1779690592.610773:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1100 00000100:00100000:2.0:1779690592.610783:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503803904:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.610886:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610903:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610916:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610933:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610940:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610946:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610967:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610976:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.610997:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.611034:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00000004:00200000:2.0:1779690592.611038:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690592.611051:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611061:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611067:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611073:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611078:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.611081:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611087:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611097:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690592.611099:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.611104:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611110:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191402c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611133:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611139:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611144:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611149:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.611152:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611157:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611164:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4c0c2d98 (ffff9e2f90226a00) 00010000:00010000:2.0:1779690592.611257:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.611263:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611270:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191402c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4c0c2d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611286:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611291:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611297:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611308:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.611310:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611315:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611323:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:2.0:1779690592.611325:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.611328:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.611332:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a191402d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.611404:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503803904:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 622us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.611412:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1100 00000100:00100000:1.0:1779690592.613217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.613466:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503804160 00000100:00100000:2.0:1779690592.613474:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503804160 00000100:00100000:2.0:1779690592.613526:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1101 00000100:00100000:2.0:1779690592.613536:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503804160:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.613553:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.613570:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191402d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3e0 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613655:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613683:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613693:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.613705:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690592.613834:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613841:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613846:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613852:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170dc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.613855:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613862:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613873:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:2.0:1779690592.613876:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690592.613880:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613885:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a191402de lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613934:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191402d7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3e0 expref: 64 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613945:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:2.0:1779690592.613947:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690592.613950:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a191402d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3e0 expref: 64 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.613960:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690592.614012:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:111666:x1866137503804160:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 478us (800us total) trans 12884902388 rc 301/301 00000100:00100000:2.0:1779690592.614019:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1101 00000100:00100000:0.0:1779690592.616166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.616473:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503804288 00000100:00100000:2.0:1779690592.616481:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503804288 00000100:00100000:2.0:1779690592.616531:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1102 00000100:00100000:2.0:1779690592.616541:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:111666:x1866137503804288:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690592.616572:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690592.616654:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:111666:x1866137503804288:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 114us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.616660:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1102 00000100:00100000:3.0:1779690592.618404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.618476:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503804416 00000100:00100000:1.0:1779690592.618483:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503804416 00000100:00100000:1.0:1779690592.618523:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1103 00000100:00100000:1.0:1779690592.618531:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:111666:x1866137503804416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.618548:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.618567:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191402ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3e7 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.618627:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.618641:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.618652:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690592.618972:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690592.618977:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690592.619060:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.619084:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191402ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3e7 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.619102:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3e7 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.619118:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690592.619120:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690592.619124:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871000, rc 0) 00000100:00100000:1.0:1779690592.619334:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+64:111666:x1866137503804416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 802us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.619341:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1103 00000100:00100000:1.0:1779690592.624329:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.624723:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503804672 00000100:00100000:2.0:1779690592.624732:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503804672 00000100:00100000:2.0:1779690592.624792:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1104 00000100:00100000:2.0:1779690592.624832:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:111666:x1866137503804672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.624852:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.624867:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690592.624894:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191402f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3e7 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.624915:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690592.624920:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690592.624933:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a191402fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3ee expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.625540:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a19140301 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.625554:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a19140301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.625563:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a19140301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.625573:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2a:0x0]: returning size 0 00010000:00010000:2.0:1779690592.625612:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a191402fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3ee expref: 66 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.625625:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a19140301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3ee expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.625633:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226a00) 00010000:00010000:2.0:1779690592.625635:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690592.625637:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170d200, rc 0) 00000100:00100000:2.0:1779690592.625700:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:111666:x1866137503804672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 899us (1380us total) trans 12884902389 rc 0/0 00000100:00100000:2.0:1779690592.625717:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1104 00000100:00100000:0.0:1779690592.639111:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.639215:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503804800 00000100:00100000:2.0:1779690592.639225:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503804800 00000100:00100000:2.0:1779690592.639387:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1105 00000100:00100000:2.0:1779690592.639398:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+65:111666:x1866137503804800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.639432:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.639451:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1914030f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3f5 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.639515:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.639529:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.639540:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.639740:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690592.639745:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690592.639870:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.639901:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d800/0xb4bb873a1914030f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3f5 expref: 67 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.640028:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3f5 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.640051:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690592.640054:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690592.640057:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690592.640123:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+66:111666:x1866137503804800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 726us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.640129:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1105 00000100:00100000:3.0:1779690592.643785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.643997:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805056 00000100:00100000:1.0:1779690592.644007:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805056 00000100:00100000:1.0:1779690592.644060:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1106 00000100:00100000:1.0:1779690592.644070:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:111666:x1866137503805056:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.644121:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1779690592.644147:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170d200/0xb4bb873a19140301 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3ee expref: 66 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644165:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226a00) 00010000:00010000:1.0:1779690592.644183:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e309170dc00/0xb4bb873a19140316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3f5 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644192:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690592.644195:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690592.644214:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644226:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 74 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644260:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644293:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 74 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.644307:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 74 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.644322:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492364800:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690592.644406:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.646212:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492364800:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690592.646236:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.647191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.647627:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805184 00000100:00100000:1.0:1779690592.647633:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805184 00010000:00010000:1.0:1779690592.647678:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 75 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.647715:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3326 00000100:00100000:1.0:1779690592.647723:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+75:2391:x1866137503805184:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690592.647737:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690592.647742:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 75 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647771:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 75 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647791:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914027c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3c4 expref: 75 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647830:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690592.647835:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647843:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647851:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.647871:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1779690592.647985:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690592.648134:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648142:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648165:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648174:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648183:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648451:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648460:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648466:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648485:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.648489:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648497:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648507:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690592.648510:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.648513:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648519:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a1914031d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648537:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648543:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648549:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648554:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.648556:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648562:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648580:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34059f58 (ffff9e2f90226d00) 00010000:00010000:2.0:1779690592.648583:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.648586:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.648591:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140324 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34059f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.648645:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+64:111666:x1866137503805056:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4576us (4867us total) trans 0 rc -2/-2 00000100:00100000:2.0:1779690592.648653:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1106 00000100:00100000:1.0:1779690592.650607:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+74:2391:x1866137503805184:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 185us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.650624:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3326 00000100:00100000:3.0:1779690592.650734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.651061:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805312 00000100:00100000:2.0:1779690592.651069:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805312 00000100:00100000:2.0:1779690592.651266:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1107 00000100:00100000:2.0:1779690592.651276:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:111666:x1866137503805312:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.651293:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.651312:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1914032b lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee3fc expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651340:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651351:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651361:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651438:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a1914032b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 66 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651458:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 65 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.651466:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:2.0:1779690592.651469:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690592.651472:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4e800, rc 0) 00000100:00100000:2.0:1779690592.651525:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:111666:x1866137503805312:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 250us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.651532:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1107 00000100:00100000:3.0:1779690592.656604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.657072:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805568 00000100:00100000:2.0:1779690592.657082:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805568 00000100:00100000:2.0:1779690592.657223:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1108 00000100:00100000:2.0:1779690592.657234:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+65:111666:x1866137503805568:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.657319:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.657336:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.657348:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690592.657536:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c8e72bce reply state 00000000cd0624aa transno 12884902390 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.657545:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690592.657630:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+67:111666:x1866137503805568:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 398us (1033us total) trans 12884902390 rc 0/0 00000100:00100000:2.0:1779690592.657648:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1108 00010000:00010000:3.0:1779690592.658888:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658898:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658917:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658923:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690592.658927:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658935:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658961:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.658964:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690592.658969:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.658975:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140339 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.660178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.660504:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805696 00000100:00100000:1.0:1779690592.660514:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805696 00000100:00100000:1.0:1779690592.660568:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1109 00000100:00100000:1.0:1779690592.660578:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:111666:x1866137503805696:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.660600:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.660617:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee403 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.660681:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 67 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.660694:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 67 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.660702:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:1.0:1779690592.660705:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1779690592.660708:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871400, rc 0) 00000100:00100000:1.0:1779690592.660764:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+67:111666:x1866137503805696:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 187us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.660770:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1109 00000100:00100000:0.0:1779690592.662643:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.662712:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503805824 00000100:00100000:3.0:1779690592.662720:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503805824 00000100:00100000:3.0:1779690592.662769:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:3.0:1779690592.662778:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+67:111666:x1866137503805824:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1779690592.662944:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+67:111666:x1866137503805824:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 167us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.662952:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:0.0:1779690592.664755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.664841:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503806080 00000100:00100000:3.0:1779690592.664848:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503806080 00000100:00100000:3.0:1779690592.664879:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:3.0:1779690592.664886:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+67:111666:x1866137503806080:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690592.665143:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806080:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 256us (391us total) trans 12884902391 rc 0/0 00000100:00100000:3.0:1779690592.665150:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:1.0:1779690592.667075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.667142:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503806336 00000100:00100000:2.0:1779690592.667149:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503806336 00000100:00100000:2.0:1779690592.667191:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1110 00000100:00100000:2.0:1779690592.667198:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806336:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690592.667301:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806336:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.667308:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1110 00000100:00100000:1.0:1779690592.669065:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.669134:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503806592 00000100:00100000:2.0:1779690592.669140:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503806592 00000100:00100000:2.0:1779690592.669179:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1111 00000100:00100000:2.0:1779690592.669186:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.669201:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.669219:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee40a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.669307:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.669321:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.669330:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.669358:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.669388:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 69 pid: 57561 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.669401:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492364928:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690592.669499:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1779690592.671545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.671612:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503806720 00000100:00100000:3.0:1779690592.671618:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503806720 00010000:00010000:3.0:1779690592.671646:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 70 pid: 57561 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.671691:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3327 00000100:00100000:3.0:1779690592.671699:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+70:2392:x1866137503806720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690592.671709:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690592.671715:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 70 pid: 57561 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.671727:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 70 pid: 57561 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.671747:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.671752:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.671761:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.671768:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.671783:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690592.671851:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+70:2392:x1866137503806720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 152us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.671858:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3327 00010000:00010000:2.0:1779690592.672451:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140340 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee403 expref: 69 pid: 57561 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.672468:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492364928:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690592.672496:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.672504:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.672510:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.672526:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2a:0x0]: returning size 0 00000004:00080000:2.0:1779690592.672868:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f2:0x0], index 0: 0 00010000:00010000:2.0:1779690592.673241:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.673369:0:57584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:57584:1866137492365056:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1779690592.673411:0:57584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690592.673441:0:57584:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089b47cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.673526:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492365056 00000100:00100000:1.0:1779690592.673532:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492365056 00000100:00100000:1.0:1779690592.673575:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6499 00000100:00100000:1.0:1779690592.673583:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:57584:x1866137492365056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1779690592.673631:0:6583:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 514 00010000:00010000:2.0:1779690592.674418:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674428:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674442:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.674446:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674454:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674467:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:2.0:1779690592.674469:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690592.674473:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674479:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a1914034e lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674528:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140347 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee40a expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674538:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226d00) 00010000:00010000:2.0:1779690592.674540:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1779690592.674544:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee40a expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.674558:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f200, rc 0) 00000100:00100000:2.0:1779690592.675044:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806592:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5857us (5980us total) trans 12884902392 rc 301/301 00000100:00100000:2.0:1779690592.675052:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1111 00000100:00100000:0.0:1779690592.681212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.681333:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503806976 00000100:00100000:3.0:1779690592.681341:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503806976 00000100:00100000:3.0:1779690592.681392:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:3.0:1779690592.681402:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+68:111666:x1866137503806976:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1779690592.681721:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+69:111666:x1866137503806976:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 320us (514us total) trans 12884902393 rc 0/0 00000100:00100000:3.0:1779690592.681729:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:3.0:1779690592.683509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.685235:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807104 00000100:00100000:2.0:1779690592.685252:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807104 00000100:00100000:2.0:1779690592.685313:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1112 00000100:00100000:2.0:1779690592.685325:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+69:111666:x1866137503807104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.685358:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.685378:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914035c lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee411 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685585:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685601:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685614:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.685651:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2a:0x0]: returning size 0 00000004:00200000:2.0:1779690592.685655:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690592.685674:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685701:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914035c lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee411 expref: 71 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685721:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee411 expref: 70 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.685729:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:2.0:1779690592.685732:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1779690592.685736:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f600, rc 0) 00000100:00100000:2.0:1779690592.685886:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+70:111666:x1866137503807104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 478us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.685894:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1112 00000100:00100000:0.0:1779690592.688198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.688268:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807232 00000100:00100000:3.0:1779690592.688276:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807232 00000100:00100000:3.0:1779690592.688342:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6500 00000100:00100000:3.0:1779690592.688351:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2390:x1866137503807232:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690592.688365:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690592.688381:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee418 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690592.688403:0:22747:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690592.688419:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690592.688421:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690592.688428:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.688444:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.688456:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4bc00, rc 0) 00000100:00100000:3.0:1779690592.688502:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2390:x1866137503807232:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 153us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.688509:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6500 00000100:00080000:0.0:1779690592.688764:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690592.691851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.691904:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807488 00000100:00100000:2.0:1779690592.691914:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807488 00000100:00100000:2.0:1779690592.691968:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1113 00000100:00100000:2.0:1779690592.691979:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+70:111666:x1866137503807488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690592.692077:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+70:111666:x1866137503807488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.692085:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1113 00000100:00100000:3.0:1779690592.694608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.694683:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807616 00000100:00100000:2.0:1779690592.694691:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807616 00000100:00100000:2.0:1779690592.694737:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6501 00000100:00100000:2.0:1779690592.694746:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+8:111666:x1866137503807616:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.694763:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.694778:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee41f expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.694840:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.694849:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690592.694851:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690592.694855:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.694887:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.694919:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 3420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.694932:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492365184:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690592.695002:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.697096:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:57584:x1866137492365056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23509us (23680us total) trans 4294968353 rc 0/0 00000100:00100000:1.0:1779690592.697105:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6499 00000100:00100000:3.0:1779690592.697157:0:57584:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:57584:1866137492365056:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1779690592.697171:0:57584:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1f2:0x0]-[0x240000400:0x221:0x0] 00000100:00100000:2.0:1779690592.697281:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308678ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492365184:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690592.697317:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.697335:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e309170dc00, rc 0) 00000100:00100000:2.0:1779690592.697400:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:111666:x1866137503807616:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2656us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.697408:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6501 00000100:00100000:0.0:1779690592.697978:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.698021:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807744 00000100:00100000:1.0:1779690592.698027:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807744 00010000:00010000:1.0:1779690592.698052:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 3420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.698103:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3328 00000100:00100000:1.0:1779690592.698113:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503807744:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690592.698127:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690592.698146:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 3420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.698158:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 3420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.698180:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8b1cb4/0xb4bb873a1914036a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee418 expref: 9 pid: 22747 timeout: 3420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.698193:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.698195:0:5781:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.698201:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.698211:0:5781:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.698243:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.698255:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5781:1866137492365312:192.168.203.5@tcp:105: 00000100:00100000:1.0:1779690592.699505:0:5781:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381780 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.705153:0:5781:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5781:1866137492365312:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690592.705177:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690592.705234:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503807744:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 7122us (7255us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.705245:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3328 00000100:00100000:0.0:1779690592.716328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.716443:0:6586:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503807872 00000100:00100000:3.0:1779690592.716452:0:6586:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503807872 00002000:00100000:3.0:1779690592.716496:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f2:0x0] (0->1048575) req@ffff9e2f94fd7800 x1866137503807872/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:73/0 lens 488/0 e 0 to 0 dl 1779690603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690592.716508:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd7800 with x1866137503807872 ext(0->1048575) 00002000:00010000:3.0:1779690592.716514:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f94fd7800 00000100:00100000:3.0:1779690592.716543:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2089 00000100:00100000:3.0:1779690592.716551:0:6586:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503807872:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.718047:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690592.731460:0:6586:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503807872:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 14900us (15131us total) trans 4294968354 rc 0/0 00000100:00100000:2.0:1779690592.731474:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2089 00002000:00100000:2.0:1779690592.731486:0:6586:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f2:0x0] (0->1048575) req@ffff9e2f94fd7800 x1866137503807872/t4294968354(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:73/0 lens 488/448 e 0 to 0 dl 1779690603 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690592.731497:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd7800 with x1866137503807872 ext(0->1048575) 00002000:00010000:2.0:1779690592.731503:0:6586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f94fd7800 00000100:00100000:3.0:1779690592.733971:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.734084:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808000 00000100:00100000:2.0:1779690592.734092:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808000 00000100:00100000:2.0:1779690592.734197:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1114 00000100:00100000:2.0:1779690592.734219:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+70:111666:x1866137503808000:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1779690592.769993:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902376 is committed 00000001:00080000:3.0:1779690592.770008:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902367 is committed 00000020:00080000:3.0:1779690592.770015:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e30847e4f00 refcount 2 committed 0 result 0 batchid 8590018969 00000020:00080000:3.0:1779690592.770020:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e30847e4e40 00000020:00080000:3.0:1779690592.770023:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e30b42e1800 00000001:00080000:3.0:1779690592.770042:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902392 is committed 00000001:00080000:3.0:1779690592.770054:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902387 is committed 00000020:00080000:3.0:1779690592.770059:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f826e7a80 refcount 2 committed 0 result 0 batchid 8590018970 00000020:00080000:3.0:1779690592.770062:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088359b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f826e7240 00000020:00080000:3.0:1779690592.770077:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3088359800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e30bb097800 00000100:00100000:1.0:1779690592.770087:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+64:111666:x1866137503808000:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 35866us (36119us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.770097:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1114 00000001:00080000:3.0:1779690592.770119:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902393 is committed 00000004:00080000:3.0:1779690592.770131:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000020:00080000:0.0:1779690592.770199:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018970 committed batchid 8590018968 00000100:00100000:3.0:1779690592.770305:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492365440:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1779690592.770354:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1779690592.770382:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018968 00000100:00100000:2.0:1779690592.771586:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492365440 00000100:00100000:2.0:1779690592.771594:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492365440 00000100:00100000:2.0:1779690592.771646:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6502 00000100:00100000:2.0:1779690592.771655:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3319:x1866137492365440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1779690592.771680:0:22279:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:497 count 1 00002000:00010000:2.0:1779690592.771709:0:22279:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f1:0x0] initial LVB size: 1048576, mtime: 0x6a13ec5c, atime: 0x6a13ec5c, ctime: 0x6a13ec5c, blocks: 0x803 00010000:00010000:2.0:1779690592.771717:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.771733:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690592.771735:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690592.771740:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.771753:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.771763:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.771770:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.771984:0:22279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1779690592.772586:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1779690592.772593:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.772603:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690592.772607:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.772616:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.772634:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.772641:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c3de623/0xb4bb873a19140378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.772674:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690592.772676:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690592.772678:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1779690592.775589:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3319:x1866137492365440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3926us (5226us total) trans 4294968455 rc 0/0 00000100:00100000:2.0:1779690592.775618:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6502 00000004:00080000:3.0:1779690592.777287:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f82fa1c00/2, rc 0, transno 4294968455 00000100:00100000:3.0:1779690592.777298:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492365440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1779690592.777404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690592.778896:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808128 00000100:00100000:0.0:1779690592.778904:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808128 00000100:00100000:0.0:1779690592.778963:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6503 00000100:00100000:0.0:1779690592.778972:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+10:2390:x1866137503808128:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1779690592.837265:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968353 is committed 00000001:00080000:1.0:1779690592.837284:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968354 is committed 00000001:00080000:1.0:1779690592.837295:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968352 is committed 00000100:00100000:0.0:1779690592.837433:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+8:2390:x1866137503808128:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 58457us (60026us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690592.837444:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6503 00000100:00100000:0.0:1779690592.839926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.840171:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808384 00000100:00100000:3.0:1779690592.840180:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808384 00000100:00100000:3.0:1779690592.840231:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1115 00000100:00100000:3.0:1779690592.840241:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:111666:x1866137503808384:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1779690592.840299:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690592.840322:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140363 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee411 expref: 55 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.840339:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.840343:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690592.840369:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.840382:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.840390:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1779690592.840543:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000016354a68 reply state 000000001a4f2250 transno 12884902394 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.840569:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1779690592.840653:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:111666:x1866137503808384:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 413us (732us total) trans 12884902394 rc 0/0 00000100:00100000:3.0:1779690592.840660:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1115 00010000:00010000:3.0:1779690592.842284:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842296:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842303:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842308:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ae00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690592.842312:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842319:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842331:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.842334:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690592.842338:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.842343:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a1914037f lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690592.843190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.843790:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808512 00000100:00100000:2.0:1779690592.843963:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808512 00000100:00100000:0.0:1779690592.844109:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1116 00000100:00100000:0.0:1779690592.844119:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:111666:x1866137503808512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690592.844140:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690592.844157:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee426 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.844206:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.844219:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.844234:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:0.0:1779690592.844237:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690592.844240:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690592.844328:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:111666:x1866137503808512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 210us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690592.844335:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1116 00000100:00100000:3.0:1779690592.846402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.846463:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808640 00000100:00100000:2.0:1779690592.846470:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808640 00000100:00100000:2.0:1779690592.846518:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6504 00000100:00100000:2.0:1779690592.846527:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503808640:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1779690592.846765:0:22747:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1f2:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1779690592.846769:0:22747:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1f2:0x0] updating lvb mtime from disk: 0 -> 1779690588 00002000:00010000:2.0:1779690592.846772:0:22747:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x240000400:0x1f2:0x0] updating lvb atime from disk: 0 -> 1779690591 00002000:00010000:2.0:1779690592.846774:0:22747:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1f2:0x0] updating lvb ctime from disk: 0 -> 1779690588 00002000:00010000:2.0:1779690592.846776:0:22747:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:2.0:1779690592.846909:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503808640:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 374us (505us total) trans 4294968355 rc 0/0 00000100:00100000:2.0:1779690592.846918:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6504 00000100:00100000:2.0:1779690592.849010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.849096:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503808896 00000100:00100000:1.0:1779690592.849105:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503808896 00000100:00100000:1.0:1779690592.849174:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1117 00000100:00100000:1.0:1779690592.849184:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+56:111666:x1866137503808896:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.849234:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.849260:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.849269:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.849301:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.849315:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 56 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.849327:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492365568:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690592.849440:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f4fee40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.853115:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.853202:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492365568:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690592.853226:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.853283:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809024 00000100:00100000:3.0:1779690592.853300:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809024 00010000:00010000:3.0:1779690592.853330:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 57 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.853365:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3329 00000100:00100000:3.0:1779690592.853373:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+57:2391:x1866137503809024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690592.853386:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690592.853391:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 57 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853403:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 57 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853422:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140332 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3fc expref: 57 pid: 57585 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853437:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.853441:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853450:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853457:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.853481:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690592.853521:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+56:2391:x1866137503809024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 149us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.853539:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3329 00010000:00010000:2.0:1779690592.853653:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853661:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853695:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853702:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853708:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853713:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.853718:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853724:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853733:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:2.0:1779690592.853735:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690592.853739:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.853744:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914038d lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.853796:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:111666:x1866137503808896:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 4612us (4790us total) trans 0 rc -22/-22 00000100:00100000:2.0:1779690592.853829:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1117 00000100:00100000:3.0:1779690592.856407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.856479:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809152 00000100:00100000:2.0:1779690592.856487:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809152 00000100:00100000:2.0:1779690592.856536:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6505 00000100:00100000:2.0:1779690592.856557:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503809152:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690592.856604:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.856624:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.856633:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1779690592.856634:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1779690592.856638:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.856670:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.856683:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 9 pid: 6581 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.856696:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492365696:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690592.856762:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690592.860367:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492365696:192.168.203.5@tcp:104: 00010000:00010000:2.0:1779690592.860406:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.860917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.861035:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809280 00000100:00100000:1.0:1779690592.861042:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809280 00010000:00010000:1.0:1779690592.861075:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 10 pid: 6581 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.861107:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3330 00000100:00100000:1.0:1779690592.861116:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503809280:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690592.861129:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690592.861148:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 10 pid: 6581 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.861160:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 10 pid: 6581 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.861180:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003139ab28/0xb4bb873a19140371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee41f expref: 10 pid: 6581 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.861195:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.861197:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.861201:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.861211:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.861240:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690592.861294:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503809280:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 179us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.861302:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3330 00010000:00010000:3.0:1779690592.862152:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862163:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862187:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862195:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862203:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862209:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e309170d200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690592.862214:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862222:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862234:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.862260:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c3de623/0xb4bb873a19140394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.862320:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503809152:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 5764us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.862328:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6505 00000100:00100000:3.0:1779690592.864439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.864501:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809536 00000100:00100000:1.0:1779690592.864508:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809536 00000100:00100000:1.0:1779690592.864556:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1118 00000100:00100000:1.0:1779690592.864565:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:111666:x1866137503809536:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690592.864632:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864647:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864657:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864882:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864894:0:64445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864909:0:64445:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864940:0:64445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.864952:0:64445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.864983:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492365824:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690592.865055:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8f4fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1779690592.868075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.868129:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809664 00000100:00100000:3.0:1779690592.868136:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809664 00010000:00010000:3.0:1779690592.868166:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 57 pid: 57559 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.868194:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3331 00000100:00100000:3.0:1779690592.868201:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503809664:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690592.868213:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690592.868218:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 5/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 57 pid: 57559 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.868230:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 57 pid: 57559 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.868257:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:3.0:1779690592.868262:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.868270:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.868288:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.868304:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690592.868347:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+57:2392:x1866137503809664:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.868353:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3331 00010000:00010000:1.0:1779690592.868459:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140386 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee426 expref: 56 pid: 57559 timeout: 3420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.868474:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492365824:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690592.868490:0:64445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.868498:0:64445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.868503:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690592.868654:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902395 00000001:00080000:1.0:1779690592.868792:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902396 00000001:00080000:1.0:1779690592.868869:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902397 00000100:00100000:1.0:1779690592.868948:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:64445:1866137492365952:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1779690592.868987:0:64445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690592.869010:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f934fb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690592.869072:0:40691:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492365952 00000100:00100000:3.0:1779690592.869077:0:40691:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492365952 00000100:00100000:3.0:1779690592.869111:0:40691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464 00000100:00100000:3.0:1779690592.869117:0:40691:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:64445:x1866137492365952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1779690592.869177:0:40691:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:64445:x1866137492365952:12345-0@lo:1000:mdt00_004.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690592.869184:0:40691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464 00000100:00100000:0.0:1779690592.869563:0:64445:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968353 gen 2 00000100:00100000:0.0:1779690592.869577:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:64445:1866137492365952:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1779690592.870064:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902398 00000100:00100000:0.0:1779690592.870123:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:64445:1866137492366080:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1779690592.870158:0:64445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690592.870180:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82f91540 going to sleep for 11 seconds 00000100:00100000:1.0:1779690592.870192:0:41581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366080 00000100:00100000:1.0:1779690592.870198:0:41581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366080 00000100:00100000:1.0:1779690592.870231:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1779690592.870237:0:41581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:64445:x1866137492366080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1779690592.870404:0:41581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:64445:x1866137492366080:12345-0@lo:1000:mdt00_004.0 Request processed in 166us (244us total) trans 4294968356 rc 0/0 00000100:00100000:1.0:1779690592.870417:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:0.0:1779690592.870467:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:64445:1866137492366080:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1779690592.870530:0:64445:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902399 00010000:00010000:0.0:1779690592.870554:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870562:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870569:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870574:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690592.870578:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870586:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870599:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226700) 00010000:00010000:0.0:1779690592.870602:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690592.870606:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870612:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191403a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870638:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870644:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870650:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870661:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690592.870665:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870670:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870678:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:0.0:1779690592.870680:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690592.870686:0:64445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870696:0:64445:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870705:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.870728:0:64445:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690592.870739:0:64445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492366208:192.168.203.5@tcp:105: 00000100:00100000:1.0:1779690592.874044:0:64445:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82f91540 going to sleep for 11 seconds 00000100:00100000:2.0:1779690592.875851:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.875902:0:64445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:64445:1866137492366208:192.168.203.5@tcp:105: 00010000:00010000:1.0:1779690592.875927:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.875936:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503809792 00010000:00010000:1.0:1779690592.875937:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a191402b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.875942:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503809792 00010000:00010000:1.0:1779690592.875965:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.875976:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.875983:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 152 00010000:00010000:1.0:1779690592.875986:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.875990:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:111664:x1866137503809792:12345-192.168.203.5@tcp:49:tar.0 00010000:00010000:1.0:1779690592.875996:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876001:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876006:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876010:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.876013:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876029:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876040:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:1.0:1779690592.876042:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.876045:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876050:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403a9 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876062:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876067:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876072:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876076:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.876079:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876084:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.876090:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:1.0:1779690592.876092:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690592.876095:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.876109:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+56:111664:x1866137503809792:12345-192.168.203.5@tcp:49:tar.0 Request processed in 119us (263us total) trans 0 rc 0/0 00010000:00010000:1.0:1779690592.876109:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914039b lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.876117:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 152 00000100:00100000:1.0:1779690592.876296:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:111666:x1866137503809536:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 11732us (11862us total) trans 12884902400 rc 0/0 00000100:00100000:1.0:1779690592.876304:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1118 00000020:00080000:1.0:1779690592.876307:0:64445:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1779690592.876444:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690592.876449:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690592.876981:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 13 00000040:00080000:0.0:1779690592.876989:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690592.879877:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.880287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690592.880557:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810048 00000100:00100000:1.0:1779690592.880557:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810176 00000100:00100000:2.0:1779690592.880565:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810048 00000100:00100000:1.0:1779690592.880565:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810176 00000100:00100000:2.0:1779690592.880617:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:2.0:1779690592.880627:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+60:111666:x1866137503810048:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690592.880745:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6506 00000100:00100000:1.0:1779690592.880752:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+18:111664:x1866137503810176:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:1.0:1779690592.880763:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.880781:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee42d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690592.880836:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f2:0x0] initial LVB size: 1048576, mtime: 0x6a13ec5c, atime: 0x6a13ec5f, ctime: 0x6a13ec5c, blocks: 0x803 00010000:00010000:1.0:1779690592.880854:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.880856:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690592.880863:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.880877:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.880889:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870400, rc 0) 00000100:00100000:1.0:1779690592.880950:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:111664:x1866137503810176:12345-192.168.203.5@tcp:101:tar.0 Request processed in 197us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.880967:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6506 00000004:00080000:2.0:1779690592.882244:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x2a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1779690592.882358:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902401 00010000:00010000:2.0:1779690592.882411:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882425:0:57563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882434:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882442:0:57563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882448:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882454:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.882480:0:57563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690592.882556:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+62:111666:x1866137503810048:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1928us (2683us total) trans 12884902402 rc 0/0 00000100:00100000:2.0:1779690592.882565:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 153 00000020:00080000:2.0:1779690592.882569:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1779690592.882709:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690592.882715:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.882731:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690592.882735:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.882743:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.882754:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2a:0x0].0x0 (ffff9e2f90226000) 00010000:00010000:3.0:1779690592.882756:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690592.882761:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.882766:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a191403b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690592.882783:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690592.882785:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690592.882787:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690592.888007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.888576:0:37860:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810304 00000100:00100000:1.0:1779690592.888586:0:37860:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810304 00002000:00100000:1.0:1779690592.888642:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1f2:0x0] (0->4095) req@ffff9e2f81e95f80 x1866137503810304/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:73/0 lens 488/0 e 0 to 0 dl 1779690603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690592.888653:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e95f80 with x1866137503810304 ext(0->4095) 00002000:00010000:1.0:1779690592.888659:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f81e95f80 00000100:00100000:1.0:1779690592.888692:0:37860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2090 00000100:00100000:1.0:1779690592.888700:0:37860:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503810304:12345-192.168.203.5@tcp:3:tar.0 00000100:00100000:1.0:1779690592.888939:0:37860:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503810304:12345-192.168.203.5@tcp:3:tar.0 Request processed in 238us (939us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1779690592.888947:0:37860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2090 00002000:00100000:1.0:1779690592.888953:0:37860:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x1f2:0x0] (0->4095) req@ffff9e2f81e95f80 x1866137503810304/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:73/0 lens 488/4536 e 0 to 0 dl 1779690603 ref 1 fl Complete:/600/0 rc 4096/4096 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1779690592.888961:0:37860:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f81e95f80 with x1866137503810304 ext(0->4095) 00002000:00010000:1.0:1779690592.888964:0:37860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2f81e95f80 00000100:00100000:2.0:1779690592.896406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690592.896485:0:6588:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810432 00000100:00100000:3.0:1779690592.896494:0:6588:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810432 00002000:00100000:3.0:1779690592.896537:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1f2:0x0] (4096->1048575) req@ffff9e30a8e1c380 x1866137503810432/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:73/0 lens 488/0 e 0 to 0 dl 1779690603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1779690592.896548:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e1c380 with x1866137503810432 ext(4096->1048575) 00002000:00010000:3.0:1779690592.896553:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30a8e1c380 00000100:00100000:3.0:1779690592.896593:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2091 00000100:00100000:3.0:1779690592.896609:0:6588:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503810432:12345-192.168.203.5@tcp:3:tar.0 00000100:00100000:0.0:1779690592.915324:0:6588:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503810432:12345-192.168.203.5@tcp:3:tar.0 Request processed in 18707us (18917us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1779690592.915347:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2091 00002000:00100000:0.0:1779690592.915360:0:6588:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1f2:0x0] (4096->1048575) req@ffff9e30a8e1c380 x1866137503810432/t0(0) o3->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:73/0 lens 488/440 e 0 to 0 dl 1779690603 ref 1 fl Complete:/600/0 rc 1044480/1044480 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1779690592.915371:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e30a8e1c380 with x1866137503810432 ext(4096->1048575) 00002000:00010000:0.0:1779690592.915376:0:6588:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e30a8e1c380 00000100:00100000:2.0:1779690592.934444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690592.934575:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810560 00000100:00100000:0.0:1779690592.934584:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810560 00000100:00100000:0.0:1779690592.934639:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1119 00000100:00100000:0.0:1779690592.934650:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+56:111665:x1866137503810560:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:0.0:1779690592.934669:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690592.934690:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee434 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.934753:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.934766:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.934778:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690592.935028:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690592.935031:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690592.935089:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.935107:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee434 expref: 58 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.935123:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee434 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.935129:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:0.0:1779690592.935131:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690592.935133:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690592.935179:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+57:111665:x1866137503810560:12345-192.168.203.5@tcp:101:tar.0 Request processed in 531us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690592.935185:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1119 00000100:00100000:3.0:1779690592.937401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.937571:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810816 00000100:00100000:1.0:1779690592.937579:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810816 00000100:00100000:1.0:1779690592.937630:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1120 00000100:00100000:1.0:1779690592.937640:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+57:111665:x1866137503810816:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:1.0:1779690592.937656:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.937671:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a191403cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee43b expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690592.937925:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8e:0x0]: returning size 7680 00010000:00010000:1.0:1779690592.938083:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a191403cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee43b expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.938096:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:1.0:1779690592.938099:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690592.938104:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a191403cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee43b expref: 59 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.938117:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871c00, rc 0) 00000100:00100000:1.0:1779690592.938170:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+58:111665:x1866137503810816:12345-192.168.203.5@tcp:101:tar.0 Request processed in 533us (775us total) trans 12884902403 rc 301/301 00000100:00100000:1.0:1779690592.938178:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1120 00000100:00100000:3.0:1779690592.940267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.940352:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503810944 00000100:00100000:1.0:1779690592.940359:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503810944 00000100:00100000:1.0:1779690592.940395:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1121 00000100:00100000:1.0:1779690592.940401:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+58:111665:x1866137503810944:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:1.0:1779690592.940427:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.940440:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403da lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee442 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940481:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940492:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940512:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940521:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940525:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940529:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940744:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940752:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940758:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940763:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.940768:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940775:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940787:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:1.0:1779690592.940789:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.940794:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940879:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191403e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940893:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940898:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.940904:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941050:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.941054:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941060:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941068:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0xcf31a53d (ffff9e2f90442700) 00010000:00010000:1.0:1779690592.941070:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.941073:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941079:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a191403e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941110:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403da lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee442 expref: 59 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941130:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:1.0:1779690592.941132:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1779690592.941136:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191403da lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee442 expref: 59 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.941145:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870e00, rc 0) 00000100:00100000:1.0:1779690592.941281:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+58:111665:x1866137503810944:12345-192.168.203.5@tcp:101:tar.0 Request processed in 878us (1017us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690592.941288:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1121 00000100:00100000:2.0:1779690592.943090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690592.943149:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503811200 00000100:00100000:0.0:1779690592.943155:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503811200 00000100:00100000:0.0:1779690592.943217:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1122 00000100:00100000:0.0:1779690592.943224:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:111665:x1866137503811200:12345-192.168.203.5@tcp:36:tar.0 00010000:00010000:0.0:1779690592.943266:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690592.943286:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140298 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3cb expref: 58 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943305:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:0.0:1779690592.943319:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690592.943544:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943559:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943568:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943587:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943681:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.943692:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690592.944582:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x93:0x0]: returning size 512 00010000:00010000:0.0:1779690592.944593:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944601:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944607:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944613:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690592.944617:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944624:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944634:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:0.0:1779690592.944637:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690592.944640:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.944657:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191403ef lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690592.944672:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005b679409 reply state 00000000de4b62bf transno 12884902404 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690592.944679:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690592.944992:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:111665:x1866137503811200:12345-192.168.203.5@tcp:36:tar.0 Request processed in 1765us (1903us total) trans 12884902404 rc 0/0 00000100:00100000:0.0:1779690592.945001:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1122 00010000:00010000:1.0:1779690592.946867:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.946875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:1.0:1779690592.946884:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.946892:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.946898:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.946902:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.946910:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.946925:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0xcf31a53d (ffff9e30bf50f300) 00010000:00010000:1.0:1779690592.946928:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.946932:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.946950:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191403f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690592.947020:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503811328 00000100:00100000:2.0:1779690592.947027:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503811328 00000100:00100000:2.0:1779690592.947065:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1123 00000100:00100000:2.0:1779690592.947071:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+58:111665:x1866137503811328:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:2.0:1779690592.947087:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690592.947101:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191403fd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee449 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947141:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947150:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947156:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947162:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947165:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947169:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947240:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140412 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x93:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947244:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947258:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690592.947289:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x93:0x0]: returning size 512 00000004:00200000:2.0:1779690592.947292:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690592.947313:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947324:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947330:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947335:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947340:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4e800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.947343:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947349:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947357:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e2f90226600) 00010000:00010000:2.0:1779690592.947359:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.947362:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947368:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140404 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947387:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947393:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947399:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947404:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4fc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690592.947406:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947412:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947419:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0xcf31a53d (ffff9e2f90226400) 00010000:00010000:2.0:1779690592.947422:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690592.947425:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947430:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a1914040b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947456:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a191403fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee449 expref: 60 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947470:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f200/0xb4bb873a19140412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee449 expref: 59 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690592.947489:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x93:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:2.0:1779690592.947491:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690592.947494:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4f200, rc 0) 00000100:00100000:2.0:1779690592.947549:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+59:111665:x1866137503811328:12345-192.168.203.5@tcp:101:tar.0 Request processed in 477us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690592.947556:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1123 00000100:00100000:3.0:1779690592.952385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690592.952563:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503811584 00000100:00100000:1.0:1779690592.952573:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503811584 00000100:00100000:1.0:1779690592.952637:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1124 00000100:00100000:1.0:1779690592.952648:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+59:111665:x1866137503811584:12345-192.168.203.5@tcp:36:tar.0 00010000:00010000:1.0:1779690592.952783:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.952842:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.952855:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.952869:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.952875:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.952881:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690592.953473:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x94:0x0]: returning size 512 00010000:00010000:1.0:1779690592.953484:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953491:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953504:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953510:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.953514:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953521:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953532:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x93:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:1.0:1779690592.953535:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.953539:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.953545:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140419 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690592.953559:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dae03aeb reply state 000000003d6d9ef8 transno 12884902405 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.953567:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690592.953643:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+61:111665:x1866137503811584:12345-192.168.203.5@tcp:36:tar.0 Request processed in 996us (1265us total) trans 12884902405 rc 0/0 00000100:00100000:1.0:1779690592.953651:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1124 00000100:00100000:3.0:1779690592.956075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:0.0:1779690592.956377:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.956389:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.956396:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.956402:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690592.956407:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.956410:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503811712 00010000:00010000:0.0:1779690592.956413:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.956418:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503811712 00010000:00010000:0.0:1779690592.956427:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x93:0x0].0xcd1d5780 (ffff9e2f90442700) 00010000:00010000:0.0:1779690592.956430:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690592.956434:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.956455:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140420 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690592.956467:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1125 00000100:00100000:1.0:1779690592.956475:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+60:111665:x1866137503811712:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:1.0:1779690592.956504:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690592.956519:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140427 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee450 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956576:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956589:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956598:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956612:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956619:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956625:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956723:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914043c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956731:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956738:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690592.956765:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x94:0x0]: returning size 512 00000004:00200000:1.0:1779690592.956775:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690592.956835:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956846:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956852:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956859:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956864:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.956867:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956872:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956880:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x93:0x0].0x0 (ffff9e2f90226300) 00010000:00010000:1.0:1779690592.956883:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.956886:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956892:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914042e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956901:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956906:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956921:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956926:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.956928:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956934:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956941:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x93:0x0].0xcd1d5780 (ffff9e2f90442d00) 00010000:00010000:1.0:1779690592.956943:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.956946:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956952:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140435 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x93:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956978:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140427 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x93:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee450 expref: 62 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956989:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870000/0xb4bb873a1914043c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee450 expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.956996:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x94:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:1.0:1779690592.956998:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1779690592.957000:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870000, rc 0) 00000100:00100000:1.0:1779690592.957042:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+61:111665:x1866137503811712:12345-192.168.203.5@tcp:101:tar.0 Request processed in 567us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690592.957057:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1125 00000100:00100000:2.0:1779690592.960108:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690592.960185:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503811968 00000100:00100000:0.0:1779690592.960194:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503811968 00000100:00100000:0.0:1779690592.960244:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1126 00000100:00100000:0.0:1779690592.960304:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+61:111665:x1866137503811968:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:0.0:1779690592.960325:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690592.960343:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140443 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee457 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960457:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960471:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960480:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960492:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960499:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.960505:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690592.961138:0:57560:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f2:0x0], index 1: 0 00010000:00010000:0.0:1779690592.961358:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140458 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961368:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140458 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961376:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140458 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961403:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961410:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961416:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961421:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690592.961425:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961431:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961442:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x94:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:0.0:1779690592.961445:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690592.961449:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961455:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a1914044a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690592.961476:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f2acd29b reply state 00000000233c58f0 transno 12884902406 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690592.961483:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690592.961512:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140443 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee457 expref: 64 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961524:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140458 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee457 expref: 63 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.961531:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50f600) 00010000:00010000:0.0:1779690592.961534:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690592.961536:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:0.0:1779690592.961613:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:111665:x1866137503811968:12345-192.168.203.5@tcp:101:tar.0 Request processed in 1361us (1513us total) trans 12884902406 rc 0/0 00000100:00100000:0.0:1779690592.961621:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1126 00000100:00100000:2.0:1779690592.964402:0:57587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:57587:1866137492366336:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1779690592.964447:0:57587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690592.964500:0:57587:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7540 going to sleep for 11 seconds 00010000:00010000:1.0:1779690592.964554:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.964565:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.964573:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.964579:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690592.964583:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.964590:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.964594:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366336 00000100:00100000:3.0:1779690592.964601:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366336 00010000:00010000:1.0:1779690592.964603:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x94:0x0].0x6325532c (ffff9e30bf50f900) 00010000:00010000:1.0:1779690592.964605:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690592.964609:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690592.964614:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a19140451 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690592.964645:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6507 00000100:00100000:3.0:1779690592.964654:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:57587:x1866137492366336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1779690592.964697:0:22279:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 514 00000100:00100000:3.0:1779690592.968573:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690592.968641:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812096 00000100:00100000:0.0:1779690592.968650:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812096 00000100:00100000:0.0:1779690592.968713:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6508 00000100:00100000:0.0:1779690592.968722:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+8:111665:x1866137503812096:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:0.0:1779690592.968738:0:10273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690592.968755:0:10273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e240b5e/0xb4bb873a19140466 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee45e expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1779690592.968775:0:10273:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1779690592.968792:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690592.968828:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690592.968838:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e240b5e/0xb4bb873a19140466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee45e expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.968854:0:10273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e240b5e/0xb4bb873a19140466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee45e expref: 9 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690592.968867:0:10273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282400, rc 0) 00000100:00100000:0.0:1779690592.968928:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+9:111665:x1866137503812096:12345-192.168.203.5@tcp:101:tar.0 Request processed in 208us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690592.968935:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6508 00000100:00080000:3.0:1779690592.969173:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690592.982200:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:57587:x1866137492366336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17539us (17744us total) trans 4294968456 rc 0/0 00000100:00100000:0.0:1779690592.982213:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6507 00000100:00100000:2.0:1779690592.982326:0:57587:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:57587:1866137492366336:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1779690592.982345:0:57587:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1f2:0x0]-[0x280000400:0x221:0x0] 00000100:00100000:0.0:1779690593.093430:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.093496:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812224 00000100:00100000:2.0:1779690593.093505:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812224 00000100:00100000:2.0:1779690593.093611:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1127 00000100:00100000:2.0:1779690593.093622:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+63:111664:x1866137503812224:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:2.0:1779690593.093650:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690593.093669:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914046d lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee465 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093765:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093779:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093859:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690593.093885:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00000004:00200000:2.0:1779690593.093889:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690593.093906:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093930:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a1914046d lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee465 expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093945:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee465 expref: 64 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.093954:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:2.0:1779690593.093956:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690593.093959:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fc00, rc 0) 00000100:00100000:2.0:1779690593.094010:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+64:111664:x1866137503812224:12345-192.168.203.5@tcp:101:tar.0 Request processed in 390us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690593.094017:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1127 00000100:00100000:1.0:1779690593.096386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.096467:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812480 00000100:00100000:0.0:1779690593.096474:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812480 00000100:00100000:0.0:1779690593.096515:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:0.0:1779690593.096523:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+64:111664:x1866137503812480:12345-192.168.203.5@tcp:35:tar.0 00000100:00100000:0.0:1779690593.096730:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:111664:x1866137503812480:12345-192.168.203.5@tcp:35:tar.0 Request processed in 207us (349us total) trans 12884902407 rc 0/0 00000100:00100000:0.0:1779690593.096738:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:0.0:1779690593.107738:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.107846:0:37637:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812608 00000100:00100000:2.0:1779690593.107855:0:37637:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812608 00002000:00100000:2.0:1779690593.107899:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1f2:0x0] (0->1044991) req@ffff9e2f94fd6300 x1866137503812608/t0(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:74/0 lens 488/0 e 0 to 0 dl 1779690604 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690593.107921:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd6300 with x1866137503812608 ext(0->1044991) 00002000:00010000:2.0:1779690593.107927:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd6300 00000100:00100000:2.0:1779690593.107955:0:37637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2092 00000100:00100000:2.0:1779690593.107976:0:37637:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503812608:12345-192.168.203.5@tcp:4:tar.0 00000100:00100000:2.0:1779690593.119943:0:37637:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e775ff0e-5641-488a-99d7-1331a4992115+11:2392:x1866137503812608:12345-192.168.203.5@tcp:4:tar.0 Request processed in 11957us (12203us total) trans 4294968457 rc 0/0 00000100:00100000:2.0:1779690593.119956:0:37637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2092 00002000:00100000:2.0:1779690593.119967:0:37637:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1f2:0x0] (0->1044991) req@ffff9e2f94fd6300 x1866137503812608/t4294968457(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:74/0 lens 488/448 e 0 to 0 dl 1779690604 ref 1 fl Complete:/600/0 rc 0/0 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690593.119977:0:37637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f94fd6300 with x1866137503812608 ext(0->1044991) 00002000:00010000:2.0:1779690593.119983:0:37637:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f94fd6300 00000100:00100000:3.0:1779690593.123025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690593.123874:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812864 00000100:00100000:1.0:1779690593.123885:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812864 00000100:00100000:1.0:1779690593.123946:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1128 00000100:00100000:1.0:1779690593.123957:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:111665:x1866137503812864:12345-192.168.203.5@tcp:36:tar.0 00010000:00010000:1.0:1779690593.124020:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690593.124045:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140458 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee457 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.124063:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50f600) 00010000:00010000:1.0:1779690593.124072:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690593.124111:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.124124:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.124134:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690593.124267:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000055d6d301 reply state 000000004967c5c5 transno 12884902408 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690593.124276:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690593.124372:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+66:111665:x1866137503812864:12345-192.168.203.5@tcp:36:tar.0 Request processed in 415us (1353us total) trans 12884902408 rc 0/0 00000100:00100000:1.0:1779690593.124379:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1128 00010000:00010000:3.0:1779690593.126298:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126311:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126317:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126323:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690593.126327:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126335:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126348:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e2f90442d00) 00010000:00010000:3.0:1779690593.126351:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690593.126368:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.126374:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914047b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690593.126698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.126763:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503812992 00000100:00100000:0.0:1779690593.126770:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503812992 00000100:00100000:0.0:1779690593.126852:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1129 00000100:00100000:0.0:1779690593.126861:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:111665:x1866137503812992:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:0.0:1779690593.126887:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690593.126905:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a19140482 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee46c expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.126956:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a19140482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x95:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee46c expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.126975:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283000/0xb4bb873a19140482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x95:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee46c expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.126991:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:0.0:1779690593.126994:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690593.126996:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283000, rc 0) 00000100:00100000:0.0:1779690593.127042:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:111665:x1866137503812992:12345-192.168.203.5@tcp:101:tar.0 Request processed in 182us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690593.127048:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1129 00000100:00100000:0.0:1779690593.129285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690593.129379:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503813120 00000100:00100000:3.0:1779690593.129387:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503813120 00000100:00100000:3.0:1779690593.129440:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6509 00000100:00100000:3.0:1779690593.129449:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+11:2391:x1866137503813120:12345-192.168.203.5@tcp:2:tar.0 00002000:00010000:3.0:1779690593.129627:0:49882:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb size from disk: 0 -> 1044992 00002000:00010000:3.0:1779690593.129631:0:49882:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb mtime from disk: 0 -> 1779690588 00002000:00010000:3.0:1779690593.129633:0:49882:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1779690593.129635:0:49882:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb ctime from disk: 0 -> 1779690593 00002000:00010000:3.0:1779690593.129637:0:49882:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1779690593.129690:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503813120:12345-192.168.203.5@tcp:2:tar.0 Request processed in 241us (410us total) trans 4294968458 rc 0/0 00000100:00100000:3.0:1779690593.129698:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6509 00000100:00100000:3.0:1779690593.134884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.135081:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503813376 00000100:00100000:2.0:1779690593.135091:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503813376 00000100:00100000:2.0:1779690593.135190:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1130 00000100:00100000:2.0:1779690593.135200:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:111665:x1866137503813376:12345-192.168.203.5@tcp:55:tar.0 00010000:00010000:2.0:1779690593.135258:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135274:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135287:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135310:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135317:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135323:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135343:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bed4f600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.135347:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135354:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135366:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:2.0:1779690593.135369:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1779690593.135373:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.135379:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4f600/0xb4bb873a19140489 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690593.135447:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:111665:x1866137503813376:12345-192.168.203.5@tcp:55:tar.0 Request processed in 248us (571us total) trans 0 rc -22/-22 00000100:00100000:2.0:1779690593.135455:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1130 00000100:00100000:0.0:1779690593.136968:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.137214:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503813504 00000100:00100000:2.0:1779690593.137222:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503813504 00000100:00100000:2.0:1779690593.137345:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1131 00000100:00100000:2.0:1779690593.137354:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+66:111665:x1866137503813504:12345-192.168.203.5@tcp:101:tar.0 00010000:00010000:2.0:1779690593.137369:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690593.137385:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140490 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee473 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137412:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140497 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137438:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137448:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137524:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4e800/0xb4bb873a19140490 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee473 expref: 68 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137540:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fa00/0xb4bb873a19140497 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee473 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.137549:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:2.0:1779690593.137551:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1779690593.137555:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30bed4fa00, rc 0) 00000100:00100000:2.0:1779690593.137603:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+67:111665:x1866137503813504:12345-192.168.203.5@tcp:101:tar.0 Request processed in 250us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690593.137610:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1131 00000100:00100000:0.0:1779690593.139749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.140113:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503813760 00000100:00100000:2.0:1779690593.140122:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503813760 00000100:00100000:2.0:1779690593.140174:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1132 00000100:00100000:2.0:1779690593.140183:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+67:111665:x1866137503813760:12345-192.168.203.5@tcp:36:tar.0 00010000:00010000:2.0:1779690593.140255:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.140271:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.140293:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690593.140637:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].12, 88 off9056 00000004:00080000:2.0:1779690593.140646:0:57560:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3320714840288ns, next at 3321714838380ns, rc = 0 00000004:00010000:2.0:1779690593.140723:0:57560:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fb2839d8 reply state 00000000ebdec5ae transno 12884902409 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690593.140733:0:57560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690593.141013:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+69:111665:x1866137503813760:12345-192.168.203.5@tcp:36:tar.0 Request processed in 829us (1269us total) trans 12884902409 rc 0/0 00000100:00100000:2.0:1779690593.141020:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1132 00010000:00010000:3.0:1779690593.142157:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142169:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142176:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142182:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690593.142196:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142204:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142219:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:3.0:1779690593.142222:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690593.142227:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.142234:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a1914049e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690593.143565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690593.143633:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503813888 00000100:00100000:3.0:1779690593.143642:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503813888 00000100:00100000:3.0:1779690593.143687:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6510 00000100:00100000:3.0:1779690593.143696:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503813888:12345-192.168.203.5@tcp:2:tar.0 00002000:00010000:3.0:1779690593.143917:0:6582:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb size from disk: 1044992 -> 1044992 00002000:00010000:3.0:1779690593.143921:0:6582:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb mtime from disk: 1779690588 -> 1779690588 00002000:00010000:3.0:1779690593.143924:0:6582:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1779690593.143926:0:6582:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb ctime from disk: 1779690593 -> 1779690593 00002000:00010000:3.0:1779690593.143928:0:6582:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1779690593.143976:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+13:2391:x1866137503813888:12345-192.168.203.5@tcp:2:tar.0 Request processed in 280us (417us total) trans 4294968459 rc 0/0 00000100:00100000:3.0:1779690593.143983:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6510 00000100:00100000:1.0:1779690593.146175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.146279:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503814144 00000100:00100000:2.0:1779690593.146287:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503814144 00000100:00100000:2.0:1779690593.146335:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1133 00000100:00100000:2.0:1779690593.146344:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:111665:x1866137503814144:12345-192.168.203.5@tcp:36:tar.0 00010000:00010000:2.0:1779690593.146418:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.146434:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.146445:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690593.146625:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000380c6ea4 reply state 000000002fb711e8 transno 12884902410 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690593.146634:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690593.146714:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+70:111665:x1866137503814144:12345-192.168.203.5@tcp:36:tar.0 Request processed in 371us (546us total) trans 12884902410 rc 0/0 00000100:00100000:2.0:1779690593.146721:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1133 00000100:00100000:1.0:1779690593.149253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.149559:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503814272 00000100:00100000:2.0:1779690593.149568:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503814272 00000100:00100000:2.0:1779690593.149616:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6511 00000100:00100000:2.0:1779690593.149624:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+13:2392:x1866137503814272:12345-192.168.203.5@tcp:2:tar.0 00002000:00010000:2.0:1779690593.149834:0:6581:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb size from disk: 1044992 -> 1044992 00002000:00010000:2.0:1779690593.149838:0:6581:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb mtime from disk: 1779690588 -> 1779690588 00002000:00010000:2.0:1779690593.149841:0:6581:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1779690593.149843:0:6581:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb ctime from disk: 1779690593 -> 1779690593 00002000:00010000:2.0:1779690593.149846:0:6581:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1779690593.149890:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+14:2392:x1866137503814272:12345-192.168.203.5@tcp:2:tar.0 Request processed in 266us (649us total) trans 4294968460 rc 0/0 00000100:00100000:2.0:1779690593.149897:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6511 00010000:00010000:3.0:1779690593.151889:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151911:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151932:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151938:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690593.151943:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151951:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151967:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:3.0:1779690593.151970:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1779690593.151974:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.151980:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191404a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x95:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690593.152145:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690593.152294:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503814528 00000100:00100000:3.0:1779690593.152301:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503814528 00000100:00100000:2.0:1779690593.152416:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:2.0:1779690593.152426:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+69:111665:x1866137503814528:12345-192.168.203.5@tcp:35:tar.0 00000100:00100000:2.0:1779690593.152733:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+70:111665:x1866137503814528:12345-192.168.203.5@tcp:35:tar.0 Request processed in 307us (589us total) trans 12884902411 rc 0/0 00000100:00100000:2.0:1779690593.152740:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:1.0:1779690593.155660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.155722:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503814784 00000100:00100000:0.0:1779690593.155730:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503814784 00000100:00100000:0.0:1779690593.155778:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 156 00000100:00100000:0.0:1779690593.155788:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+70:111665:x1866137503814784:12345-192.168.203.5@tcp:35:tar.0 00000100:00100000:0.0:1779690593.156075:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+71:111665:x1866137503814784:12345-192.168.203.5@tcp:35:tar.0 Request processed in 288us (421us total) trans 12884902412 rc 0/0 00000100:00100000:0.0:1779690593.156097:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 156 00000100:00100000:1.0:1779690593.166715:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.166850:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503815040 00000100:00100000:2.0:1779690593.166860:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503815040 00000100:00100000:2.0:1779690593.166917:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1134 00000100:00100000:2.0:1779690593.166928:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+71:111667:x1866137503815040:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:2.0:1779690593.166961:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690593.166979:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a191404ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee47a expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167058:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167072:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167083:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167096:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167102:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167108:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167409:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191404c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167418:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191404c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167426:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191404c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690593.167435:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x28:0x0]: returning size 1048576 00010000:00010000:2.0:1779690593.167519:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167536:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167543:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167548:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.167553:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167559:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167571:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:2.0:1779690593.167573:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690593.167578:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167584:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a191404b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167651:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167658:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167664:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167669:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.167677:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167683:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167691:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f90226600) 00010000:00010000:2.0:1779690593.167693:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690593.167696:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167701:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191404ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167740:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a191404ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee47a expref: 74 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167751:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191404c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee47a expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.167758:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:2.0:1779690593.167760:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690593.167762:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c600, rc 0) 00000100:00100000:2.0:1779690593.168002:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+73:111667:x1866137503815040:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 1075us (1294us total) trans 12884902413 rc 0/0 00000100:00100000:2.0:1779690593.168010:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1134 00000100:00100000:1.0:1779690593.171498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690593.171530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.171980:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503815296 00000100:00100000:0.0:1779690593.171989:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503815296 00000100:00100000:0.0:1779690593.172039:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1135 00000100:00100000:0.0:1779690593.172049:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+73:111667:x1866137503815296:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:0.0:1779690593.172070:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690593.172088:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191404cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee481 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172143:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172156:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172168:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172182:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172188:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172194:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172487:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191404e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172505:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191404e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172512:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191404e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690593.172545:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x8e:0x0]: returning size 7680 00000004:00200000:0.0:1779690593.172549:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690593.172574:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191404e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172585:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.172592:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690593.172986:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503815168 00000100:00100000:3.0:1779690593.172991:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503815168 00000100:00100000:3.0:1779690593.173022:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18686 00000100:00100000:3.0:1779690593.173028:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+75:2390:x1866137503815168:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690593.173037:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690593.173053:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191404c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee47a expref: 75 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.173066:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:3.0:1779690593.173076:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690593.173135:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+74:2390:x1866137503815168:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 106us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690593.173142:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18686 00010000:00010000:0.0:1779690593.173202:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173209:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690593.173212:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173220:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173228:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:0.0:1779690593.173230:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690593.173234:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173354:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a191404d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173365:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173371:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173376:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173381:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690593.173384:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173390:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173397:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (ffff9e30bf50f400) 00010000:00010000:0.0:1779690593.173400:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690593.173402:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173407:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a191404dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173435:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191404cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee481 expref: 74 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173459:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283e00/0xb4bb873a191404e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee481 expref: 73 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.173466:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8e:0x0].0x0 (ffff9e30bf50fb00) 00010000:00010000:0.0:1779690593.173468:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690593.173470:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283e00, rc 0) 00000100:00100000:0.0:1779690593.173494:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+73:111667:x1866137503815296:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 1447us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690593.173500:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1135 00000100:00100000:1.0:1779690593.175603:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690593.175689:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503815552 00000100:00100000:3.0:1779690593.175697:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503815552 00000100:00100000:3.0:1779690593.175766:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1136 00000100:00100000:3.0:1779690593.175775:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+73:111667:x1866137503815552:12345-192.168.203.5@tcp:101:cmp.0 00010000:00010000:3.0:1779690593.175825:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690593.175845:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a191404eb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee488 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175909:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175922:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175932:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175946:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175953:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.175959:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176071:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140500 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176086:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176093:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690593.176102:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x95:0x0]: returning size 1045504 00010000:00010000:3.0:1779690593.176190:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176197:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176203:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176209:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4b800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690593.176213:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176220:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176229:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x94:0x0].0x0 (ffff9e2f90442e00) 00010000:00010000:3.0:1779690593.176232:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690593.176235:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176241:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a191404f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176264:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176269:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176275:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176280:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690593.176283:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176289:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176297:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x94:0x0].0x6325532c (ffff9e2f905ad400) 00010000:00010000:3.0:1779690593.176299:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690593.176302:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176307:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a191404f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x94:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176344:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a191404eb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x94:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee488 expref: 76 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176355:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a600/0xb4bb873a19140500 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee488 expref: 75 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.176372:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x95:0x0].0x0 (ffff9e30bf50fd00) 00010000:00010000:3.0:1779690593.176374:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690593.176377:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4a600, rc 0) 00000100:00100000:3.0:1779690593.176425:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+75:111667:x1866137503815552:12345-192.168.203.5@tcp:101:cmp.0 Request processed in 651us (828us total) trans 12884902414 rc 0/0 00000100:00100000:3.0:1779690593.176432:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1136 00000100:00100000:2.0:1779690593.187550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.187651:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503815808 00000100:00100000:0.0:1779690593.187662:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503815808 00000100:00100000:0.0:1779690593.187714:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:0.0:1779690593.187724:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+75:111667:x1866137503815808:12345-192.168.203.5@tcp:35:cmp.0 00000100:00100000:0.0:1779690593.188159:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+76:111667:x1866137503815808:12345-192.168.203.5@tcp:35:cmp.0 Request processed in 435us (617us total) trans 12884902415 rc 0/0 00000100:00100000:0.0:1779690593.188167:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:0.0:1779690593.190836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.191195:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503816064 00000100:00100000:2.0:1779690593.191203:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503816064 00000100:00100000:2.0:1779690593.191314:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:2.0:1779690593.191336:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+76:111667:x1866137503816064:12345-192.168.203.5@tcp:35:cmp.0 00000100:00100000:2.0:1779690593.191754:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+77:111667:x1866137503816064:12345-192.168.203.5@tcp:35:cmp.0 Request processed in 417us (964us total) trans 12884902416 rc 0/0 00000100:00100000:2.0:1779690593.191761:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:1.0:1779690593.207361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.207524:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503816320 00000100:00100000:2.0:1779690593.207534:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503816320 00000100:00100000:2.0:1779690593.207597:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1137 00000100:00100000:2.0:1779690593.207605:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+77:111668:x1866137503816320:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:2.0:1779690593.207656:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1779690593.207680:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4fc00/0xb4bb873a19140474 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee465 expref: 77 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207700:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53e400/0xb4bb873a191402bb lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3d9 expref: 76 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207713:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f905adb00) 00010000:00010000:2.0:1779690593.207726:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191403c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee434 expref: 75 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207735:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:2.0:1779690593.207740:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690593.207760:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207771:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207779:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207860:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207868:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.207874:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.208147:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.208156:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.208163:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690593.209276:0:64445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].12, 64 off9008 00000004:00080000:2.0:1779690593.209287:0:64445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3320783481108ns, next at 3321783479049ns, rc = 0 00010000:00010000:2.0:1779690593.209362:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209374:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209383:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209390:0:64445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209483:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209490:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209560:0:64445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690593.209581:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209587:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209593:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209598:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.209602:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209609:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209620:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:2.0:1779690593.209623:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1779690593.209627:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209633:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914051c lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209660:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209666:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209672:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209677:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.209679:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209685:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209692:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226600) 00010000:00010000:2.0:1779690593.209694:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690593.209697:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.209702:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914050e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690593.209717:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000200ad8d4 reply state 0000000041a0815a transno 12884902417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690593.209725:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690593.209834:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+76:111668:x1866137503816320:12345-192.168.203.5@tcp:36:rm.0 Request processed in 2226us (2479us total) trans 12884902417 rc 0/0 00000100:00100000:2.0:1779690593.209844:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1137 00010000:00010000:0.0:1779690593.211736:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211750:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211758:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211764:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690593.211775:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211783:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211834:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (ffff9e2f90226400) 00010000:00010000:0.0:1779690593.211837:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690593.211841:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.211847:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140515 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212472:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1779690593.212480:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212487:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690593.212490:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212496:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212506:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x28:0x0].0x0 (ffff9e2f90226800) 00010000:00010000:1.0:1779690593.212509:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1779690593.212512:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212517:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140523 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690593.212544:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690593.212546:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1779690593.212548:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690593.215745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690593.215914:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503816448 00000100:00100000:0.0:1779690593.215924:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503816448 00000100:00100000:0.0:1779690593.216012:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1138 00000100:00100000:0.0:1779690593.216023:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+75:111668:x1866137503816448:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690593.216055:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690593.216079:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914052a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee48f expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216139:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216153:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216163:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690593.216260:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690593.216264:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690593.216289:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216313:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914052a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee48f expref: 77 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216329:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee48f expref: 76 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690593.216337:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f400) 00010000:00010000:0.0:1779690593.216340:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690593.216344:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282200, rc 0) 00000100:00100000:0.0:1779690593.216410:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+76:111668:x1866137503816448:12345-192.168.203.5@tcp:101:rm.0 Request processed in 389us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690593.216416:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1138 00000100:00100000:3.0:1779690593.220193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690593.220347:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503816704 00000100:00100000:2.0:1779690593.220356:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503816704 00000100:00100000:2.0:1779690593.220502:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:2.0:1779690593.220513:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+76:111668:x1866137503816704:12345-192.168.203.5@tcp:35:rm.0 00000100:00100000:2.0:1779690593.221062:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+77:111668:x1866137503816704:12345-192.168.203.5@tcp:35:rm.0 Request processed in 549us (876us total) trans 12884902418 rc 0/0 00000100:00100000:2.0:1779690593.221070:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:2.0:1779690593.227190:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690593.227318:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503816960 00000100:00100000:3.0:1779690593.227328:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503816960 00000100:00100000:3.0:1779690593.227382:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1139 00000100:00100000:3.0:1779690593.227392:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+77:111668:x1866137503816960:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:3.0:1779690593.227443:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1779690593.227468:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bed4ec00/0xb4bb873a1914021a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x90:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee3af expref: 77 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227489:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a191400bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee331 expref: 76 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227499:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x90:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690593.227512:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee48f expref: 75 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227520:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f400) 00010000:00010000:3.0:1779690593.227526:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690593.227546:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227571:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227579:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227588:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227594:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227599:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227709:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227715:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.227722:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690593.233618:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].13, 64 off9072 00010000:00010000:2.0:1779690593.233696:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233714:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233724:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233733:0:57585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233740:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233745:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233772:0:57585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690593.233792:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233840:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233846:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233852:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4b800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.233856:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233864:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233875:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x90:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690593.233878:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1779690593.233882:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233888:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b800/0xb4bb873a19140546 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x90:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233905:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233911:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233916:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233921:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ba00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.233930:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233937:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233944:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f905ad400) 00010000:00010000:2.0:1779690593.233947:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690593.233950:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.233955:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ba00/0xb4bb873a19140538 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690593.233970:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d3d31236 reply state 000000007e471bfc transno 12884902419 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690593.233978:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1779690593.234054:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+76:111668:x1866137503816960:12345-192.168.203.5@tcp:36:rm.0 Request processed in 6660us (6869us total) trans 12884902419 rc 0/0 00000100:00100000:2.0:1779690593.234062:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1139 00010000:00010000:3.0:1779690593.234279:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1779690593.234286:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.234292:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2de00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690593.234295:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.234310:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.234318:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x90:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690593.234321:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1779690593.234323:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.234328:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a1914054d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x90:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.234344:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690593.234346:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690593.234347:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690593.235967:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.235981:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.235987:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.235992:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690593.235996:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.236012:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.236025:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (ffff9e2f905ad700) 00010000:00010000:2.0:1779690593.236027:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690593.236031:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690593.236038:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a400/0xb4bb873a1914053f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690593.739921:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690593.931575:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690593.931582:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690593.932434:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 44 count 10 00000040:00080000:0.0:1779690593.932443:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690594.754467:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690594.754507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690594.754574:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817088 00000100:00100000:1.0:1779690594.754594:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817088 00000100:00100000:1.0:1779690594.754641:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:1.0:1779690594.754650:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503817088:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690594.754715:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503817088:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690594.754722:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:3.0:1779690594.756012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690594.756041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690594.756069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690594.756132:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817344 00000100:00100000:1.0:1779690594.756138:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817344 00000100:00100000:1.0:1779690594.756183:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817472 00000100:00100000:1.0:1779690594.756186:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817472 00000100:00100000:1.0:1779690594.756208:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2988 00000100:00100000:1.0:1779690594.756216:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503817344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690594.756266:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503817344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690594.756273:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2988 00000100:00100000:1.0:1779690594.756289:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2989 00000100:00100000:1.0:1779690594.756295:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503817472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690594.756318:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503817472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690594.756323:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2989 00000100:00100000:0.0:1779690594.764332:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817216 00000100:00100000:0.0:1779690594.764345:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817216 00000100:00100000:3.0:1779690594.764400:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690594.764409:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817600 00000100:00100000:0.0:1779690594.764414:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817600 00000100:00100000:3.0:1779690594.764438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690594.764451:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 301 00000100:00080000:3.0:1779690594.764462:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690594.764463:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+62:2392:x1866137503817216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:3.0:1779690594.764467:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690594.764471:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690594.764482:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817728 00000100:00100000:3.0:1779690594.764486:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817728 00000100:00100000:3.0:1779690594.764519:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817856 00000100:00100000:3.0:1779690594.764522:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817856 00000100:00100000:3.0:1779690594.764543:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2990 00000100:00100000:0.0:1779690594.764554:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+62:2392:x1866137503817216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 92us (10044us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690594.764561:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503817728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690594.764567:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 301 00000100:00100000:0.0:1779690594.764587:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00100000:0.0:1779690594.764596:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+75:2391:x1866137503817600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690594.764607:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503817728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690594.764615:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2990 00000100:00100000:3.0:1779690594.764631:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2991 00000100:00100000:3.0:1779690594.764639:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+14:2391:x1866137503817856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690594.764642:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+75:2391:x1866137503817600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (8569us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690594.764650:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00100000:3.0:1779690594.764669:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+14:2391:x1866137503817856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690594.764676:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2991 00000100:00080000:3.0:1779690594.764699:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690594.764702:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1779690594.766953:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1779690595.785026:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690596.295244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690596.295382:0:6587:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503817984 00000100:00100000:2.0:1779690596.295391:0:6587:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503817984 00000100:00080000:3.0:1779690596.295604:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1779690596.297853:0:6587:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1ef:0x0] (0->1515) req@ffff9e2f8f409c00 x1866137503817984/t0(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:77/0 lens 2008/0 e 0 to 0 dl 1779690607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690596.297867:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f409c00 with x1866137503817984 ext(0->1515) 00002000:00010000:2.0:1779690596.297874:0:6587:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8f409c00 00000100:00100000:2.0:1779690596.297913:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2093 00000100:00100000:2.0:1779690596.297926:0:6587:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503817984:12345-192.168.203.5@tcp:4:cp.0 00000100:00100000:2.0:1779690596.298432:0:6587:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b7a1272b-3551-4679-9948-3e2276470519+15:2390:x1866137503817984:12345-192.168.203.5@tcp:4:cp.0 Request processed in 508us (3191us total) trans 4294968461 rc 0/0 00000100:00100000:2.0:1779690596.300409:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2093 00002000:00100000:2.0:1779690596.300488:0:6587:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1ef:0x0] (0->1515) req@ffff9e2f8f409c00 x1866137503817984/t4294968461(0) o4->b7a1272b-3551-4679-9948-3e2276470519@192.168.203.5@tcp:77/0 lens 2008/448 e 0 to 0 dl 1779690607 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690596.300501:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8f409c00 with x1866137503817984 ext(0->1515) 00002000:00010000:2.0:1779690596.300507:0:6587:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8f409c00 00000100:00100000:0.0:1779690596.402924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690596.403013:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818112 00000100:00100000:2.0:1779690596.403024:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818112 00000100:00100000:2.0:1779690596.403095:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1140 00000100:00100000:2.0:1779690596.403106:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+62:111612:x1866137503818112:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1779690596.403209:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+62:111612:x1866137503818112:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690596.403217:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1140 00000100:00080000:3.0:1779690596.403694:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690596.407769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690596.408138:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818368 00000100:00100000:0.0:1779690596.408148:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818368 00000100:00100000:0.0:1779690596.408208:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 160 00000100:00100000:0.0:1779690596.408219:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+62:111612:x1866137503818368:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690596.408869:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+63:111612:x1866137503818368:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 650us (1114us total) trans 12884902420 rc 0/0 00000100:00100000:0.0:1779690596.408879:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 160 00010000:00010000:3.0:1779690596.810568:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1779690596.908947:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968454 is committed 00000001:00080000:0.0:1779690596.908966:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968461 is committed 00000001:00080000:0.0:1779690596.908976:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968460 is committed 00000001:00080000:0.0:1779690596.908984:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968456 is committed 00000004:00080000:3.0:1779690597.321868:0:57584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3324896059431ns, next at 3325896056180ns, rc = 0 00000100:00100000:2.0:1779690597.321951:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690597.321953:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492366592:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.322043:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690597.322044:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690597.322098:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492367104:0@lo:400:kworker.0 00000100:00100000:3.0:1779690597.322123:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690597.322162:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367104 00000100:00100000:3.0:1779690597.322168:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367104 00000100:00100000:2.0:1779690597.322411:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492366976:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.322438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.322505:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492366720:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.322559:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.322582:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492367232:0@lo:400:kworker.0 00000100:00100000:0.0:1779690597.322642:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366720 00000100:00100000:0.0:1779690597.322647:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366720 00000100:00100000:2.0:1779690597.322682:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.322700:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1779690597.322706:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492366848:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.322727:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.322828:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366592 00000100:00100000:2.0:1779690597.322832:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366592 00000100:00100000:2.0:1779690597.322863:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1779690597.322873:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492366592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.322922:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492366592:12345-0@lo:400:kworker.0 Request processed in 51us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690597.322929:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1779690597.322968:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366464 00000100:00100000:2.0:1779690597.322971:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366464 00000100:00100000:2.0:1779690597.323065:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1779690597.323074:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492366464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690597.323099:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3825205248 avail 3823108096 00000100:00100000:2.0:1779690597.323136:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492366464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690597.323143:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000004:00080000:2.0:1779690597.323190:0:57587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3324897383395ns, next at 3325897381870ns, rc = 0 00000100:00100000:2.0:1779690597.323207:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367232 00000100:00100000:2.0:1779690597.323210:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367232 00000100:00100000:0.0:1779690597.323269:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366848 00000100:00100000:0.0:1779690597.323272:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366848 00000100:00100000:3.0:1779690597.323352:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492366976 00000100:00100000:3.0:1779690597.323356:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492366976 00000100:00100000:3.0:1779690597.323380:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1779690597.323387:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492367104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690597.323427:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492367104:12345-0@lo:400:kworker.0 Request processed in 40us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690597.323433:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1779690597.323446:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1779690597.323451:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492366976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690597.323474:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492366976:12345-0@lo:400:kworker.0 Request processed in 22us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690597.323479:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00080000:3.0:1779690597.323494:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690597.323535:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1779690597.323542:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492366720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.323573:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492366720:12345-0@lo:400:kworker.0 Request processed in 33us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690597.323580:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1779690597.323594:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1779690597.323599:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492367232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.323624:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492367232:12345-0@lo:400:kworker.0 Request processed in 25us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690597.323630:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1779690597.323652:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492367360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690597.323676:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.323722:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492366720:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.323734:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492367232:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.323782:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367360 00000100:00100000:2.0:1779690597.323785:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367360 00000100:00100000:2.0:1779690597.323822:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1779690597.323828:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492367360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690597.323838:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3755999232 00000100:00100000:2.0:1779690597.323868:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492367360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690597.323874:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1779690597.323896:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968456 gen 2 00000004:00080000:2.0:1779690597.323902:0:3319:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968453 committed transno 4294968456 00000004:00080000:2.0:1779690597.323916:0:3319:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968454 committed transno 4294968456 00000004:00080000:2.0:1779690597.323940:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f82fa1c00, transno 4294968455 00000100:00100000:2.0:1779690597.323961:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492367360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690597.324280:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492366592:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.324292:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492367104:0@lo:400:kworker.0 00000100:00100000:2.0:1779690597.324323:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690597.324334:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492366976:0@lo:400:kworker.0 00000100:00100000:0.0:1779690597.324592:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1779690597.324607:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492366848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690597.324648:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492366848:12345-0@lo:400:kworker.0 Request processed in 43us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690597.324655:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1779690597.325249:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492366848:0@lo:400:kworker.0 00000100:00080000:3.0:1779690597.325396:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690597.325400:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1779690597.492641:0:73134:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 250: Coordinator max request ========== 02:29:56 (1779690596) 00010000:00010000:1.0:1779690597.842947:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690597.887755:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902420 is committed 00000001:00080000:2.0:1779690597.887774:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902415 is committed 00000020:00080000:2.0:1779690597.887789:0:57578:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2f82f91840 refcount 2 committed 0 result 0 batchid 8590018971 00000020:00080000:2.0:1779690597.887794:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2f82f91900 00000020:00080000:2.0:1779690597.887827:0:57578:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9e3084639c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e3091137c00 00000020:00080000:2.0:1779690597.887840:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018970 batchid updated 00000004:00080000:2.0:1779690597.887866:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000001:00080000:2.0:1779690597.887878:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902419 is committed 00000004:00080000:2.0:1779690597.887884:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00080000:2.0:1779690597.887900:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:2.0:1779690597.887908:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000020:00080000:2.0:1779690597.887926:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8590018971 committed batchid 8590018970 00000020:00080000:2.0:1779690597.888099:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018970 00000100:00100000:2.0:1779690597.888250:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492367616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1779690597.888273:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492367488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1779690597.889823:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.889896:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492367744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1779690597.889928:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.890022:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367616 00000100:00100000:2.0:1779690597.890028:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367616 00000100:00100000:2.0:1779690597.890065:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367744 00000100:00100000:2.0:1779690597.890069:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367744 00000100:00100000:2.0:1779690597.890088:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1779690597.890095:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3321:x1866137492367616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1779690597.890121:0:49882:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:498 count 1 00010000:00010000:2.0:1779690597.890144:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890166:0:49882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890174:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690597.890182:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690597.890186:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890215:0:49882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890228:0:49882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 18 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690597.890242:0:49882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492367872:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690597.890297:0:49882:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1779690597.890314:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1779690597.890321:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1866137492367744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1779690597.890334:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:497 count 1 00010000:00010000:2.0:1779690597.890345:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890357:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890364:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1779690597.890366:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1779690597.890368:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890385:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690597.890401:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690597.890412:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492368000:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690597.890434:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1779690597.890583:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690597.890677:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492367488 00000100:00100000:2.0:1779690597.890682:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492367488 00000100:00100000:2.0:1779690597.890755:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6514 00000100:00100000:2.0:1779690597.890763:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492367488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1779690597.890969:0:10273:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb size from disk: 1044992 -> 1044992 00002000:00010000:2.0:1779690597.890973:0:10273:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb mtime from disk: 1779690588 -> 1779690588 00002000:00010000:2.0:1779690597.890976:0:10273:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1779690597.890978:0:10273:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb ctime from disk: 1779690593 -> 1779690593 00002000:00010000:2.0:1779690597.890980:0:10273:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:2.0:1779690597.891019:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492367488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (435us total) trans 4294968462 rc 0/0 00000100:00100000:2.0:1779690597.891027:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6514 00000004:00080000:3.0:1779690597.891170:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f963e5180/2, rc 0, transno 4294968462 00000100:00100000:3.0:1779690597.891177:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492367488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1779690597.899246:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690597.899315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690597.899361:0:49882:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:49882:1866137492367872:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690597.899389:0:49882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690597.899421:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1866137492368000:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690597.899434:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690597.899467:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818496 00000100:00100000:1.0:1779690597.899472:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818496 00010000:00010000:1.0:1779690597.899511:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 19 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690597.899577:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818624 00000100:00100000:1.0:1779690597.899581:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818624 00010000:00010000:1.0:1779690597.899594:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 20 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690597.899647:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3332 00000100:00100000:0.0:1779690597.899668:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+20:2392:x1866137503818496:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690597.899681:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690597.899687:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 20 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899698:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 20 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899719:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a191403b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee42d expref: 20 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899732:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690597.899734:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690597.899738:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899755:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899780:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690597.899847:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503818496:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 190us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690597.899859:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3332 00000100:00100000:0.0:1779690597.899879:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3333 00000100:00100000:0.0:1779690597.899886:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503818624:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690597.899894:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690597.899899:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899910:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899937:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009991808f/0xb4bb873a191401db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee39a expref: 18 pid: 6581 timeout: 3425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899947:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690597.899948:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690597.899951:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899959:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.899976:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690597.899996:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503818624:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 110us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690597.900003:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3333 00000100:00080000:1.0:1779690597.900263:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1779690597.900273:0:49882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690597.900282:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690597.900292:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690597.900300:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690597.900316:0:49882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1779690597.900870:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.900885:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.900893:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.900899:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.900913:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1779690597.901279:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3318:x1866137492367744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10957us (11347us total) trans 4294968358 rc 0/0 00000100:00100000:0.0:1779690597.901287:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6513 00010000:00010000:0.0:1779690597.901311:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1779690597.901316:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901323:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c400 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690597.901328:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901336:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901350:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901365:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc1c455/0xb4bb873a19140554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901382:0:7463:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1779690597.901385:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901392:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2de00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690597.901394:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901401:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901411:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901418:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc7323b/0xb4bb873a1914055b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690597.901431:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690597.901433:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690597.901435:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690597.901625:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3321:x1866137492367616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11529us (11802us total) trans 4294968357 rc 0/0 00000100:00100000:1.0:1779690597.901639:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6512 00010000:00010000:1.0:1779690597.901656:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1779690597.901767:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f963e5c00/2, rc 0, transno 4294968357 00000100:00100000:1.0:1779690597.901773:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492367616:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1779690597.902731:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f963e7b80/2, rc 0, transno 4294968358 00000100:00100000:2.0:1779690597.902737:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f963e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492367744:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1779690597.907432:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968356 is committed 00000001:00080000:0.0:1779690597.907831:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968355 is committed 00010000:00010000:2.0:1779690598.858140:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690599.876364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690599.876401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690599.876475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690599.876499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690599.876533:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818752 00000100:00100000:1.0:1779690599.876546:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818752 00000100:00100000:1.0:1779690599.876650:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:1.0:1779690599.876661:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503818752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690599.876739:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503818752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690599.876747:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:0.0:1779690599.877163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690599.877183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690599.877226:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819008 00000100:00100000:3.0:1779690599.877231:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819008 00000100:00100000:3.0:1779690599.877269:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819520 00000100:00100000:3.0:1779690599.877271:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819520 00000100:00100000:3.0:1779690599.877293:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2994 00000100:00100000:3.0:1779690599.877301:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503819008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690599.877337:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+7:2392:x1866137503819008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690599.877343:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2994 00000100:00100000:3.0:1779690599.877357:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2995 00000100:00100000:3.0:1779690599.877363:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503819520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690599.877392:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503819520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690599.877398:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2995 00000100:00080000:3.0:1779690599.877425:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690599.877429:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690599.878741:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819136 00000100:00100000:0.0:1779690599.878741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690599.878756:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819136 00000100:00100000:0.0:1779690599.878792:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819264 00000100:00100000:0.0:1779690599.878800:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819264 00000100:00100000:0.0:1779690599.878881:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503818880 00000100:00100000:0.0:1779690599.878886:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503818880 00000100:00100000:3.0:1779690599.878892:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819392 00000100:00100000:3.0:1779690599.878898:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819392 00000100:00100000:0.0:1779690599.878917:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 306 00000100:00100000:0.0:1779690599.878924:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+58:2392:x1866137503819264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690599.878969:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+58:2392:x1866137503819264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (2495us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690599.878976:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 306 00000100:00100000:0.0:1779690599.878990:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 307 00000100:00100000:0.0:1779690599.878996:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:2392:x1866137503818880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690599.879046:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+53:2392:x1866137503818880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 48us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690599.879052:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 307 00000100:00100000:3.0:1779690599.879071:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2996 00000100:00100000:3.0:1779690599.879141:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503819136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690599.879423:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2997 00000100:00100000:1.0:1779690599.879435:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503819392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690599.879624:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503819392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 193us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690599.879630:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2997 00000100:00100000:3.0:1779690599.880069:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503819136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 986us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690599.880084:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2996 00000100:00080000:3.0:1779690599.880134:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690599.880140:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690599.880146:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1779690599.884688:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690600.073628:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690600.073640:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690600.074243:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 44 count 9 00000040:00080000:2.0:1779690600.074252:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690600.237254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.237346:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819648 00000100:00100000:2.0:1779690600.237366:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819648 00000100:00100000:2.0:1779690600.237418:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1141 00000100:00100000:2.0:1779690600.237426:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+53:112311:x1866137503819648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690600.237443:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.237517:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee496 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.237578:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.237592:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.237602:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690600.237881:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690600.237886:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 113 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690600.237991:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.238015:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.238032:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.238040:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:2.0:1779690600.238042:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690600.238051:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c000, rc 0) 00000100:00100000:2.0:1779690600.238234:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:112311:x1866137503819648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 807us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.238242:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1141 00000100:00100000:0.0:1779690600.244799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.245007:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503819904 00000100:00100000:1.0:1779690600.245016:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503819904 00000100:00100000:1.0:1779690600.245071:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1142 00000100:00100000:1.0:1779690600.245082:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:112312:x1866137503819904:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690600.245102:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.245165:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140570 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee49d expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245254:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245268:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245279:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245309:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245317:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245324:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245759:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140585 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245768:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.245774:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.245783:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1779690600.245983:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246002:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246008:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246014:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.246019:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246027:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246039:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:1.0:1779690600.246042:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.246048:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246054:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a19140577 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246069:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246075:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246080:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246085:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.246095:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246100:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246108:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f90442900) 00010000:00010000:1.0:1779690600.246110:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.246113:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246119:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914057e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246461:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140570 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee49d expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246476:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140585 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee49d expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.246483:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690600.246485:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.246488:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871e00, rc 0) 00000100:00100000:1.0:1779690600.246552:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:112312:x1866137503819904:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1760us total) trans 12884902421 rc 0/0 00000100:00100000:1.0:1779690600.246561:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1142 00000100:00100000:3.0:1779690600.250679:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.250764:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820032 00000100:00100000:1.0:1779690600.250778:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820032 00000100:00100000:1.0:1779690600.250890:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18687 00000100:00100000:1.0:1779690600.250901:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+56:2391:x1866137503820032:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690600.250928:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690600.250951:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140585 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee49d expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.250975:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690600.250980:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690600.251045:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+55:2391:x1866137503820032:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.251056:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18687 00000100:00100000:3.0:1779690600.251061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.251162:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820160 00000100:00100000:2.0:1779690600.251167:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820160 00000100:00100000:2.0:1779690600.251199:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1143 00000100:00100000:2.0:1779690600.251206:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:112312:x1866137503820160:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1779690600.251273:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+55:112312:x1866137503820160:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.251279:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1143 00000100:00100000:0.0:1779690600.265200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.265289:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820288 00000100:00100000:2.0:1779690600.265299:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820288 00000100:00100000:2.0:1779690600.265358:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1144 00000100:00100000:2.0:1779690600.265369:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+58:112313:x1866137503820288:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690600.265389:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.265408:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4a4 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.265483:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.265499:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.265510:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690600.265718:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690600.265739:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 113 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690600.266295:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.266323:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4a4 expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.266339:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4a4 expref: 59 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.266348:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:2.0:1779690600.266351:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690600.266354:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d600, rc 0) 00000100:00100000:2.0:1779690600.266411:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+59:112313:x1866137503820288:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1045us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.266535:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1144 00000100:00100000:0.0:1779690600.269012:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.271838:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820416 00000100:00100000:2.0:1779690600.271853:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820416 00000100:00100000:2.0:1779690600.271929:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1145 00000100:00100000:2.0:1779690600.271940:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+59:112313:x1866137503820416:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690600.271959:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.271985:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4ab expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272050:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272064:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272094:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272147:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272156:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272163:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272455:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272462:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272468:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272473:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.272477:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272483:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272494:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:2.0:1779690600.272496:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.272500:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272511:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c800/0xb4bb873a191405a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272523:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272529:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272534:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272538:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.272541:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272546:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272552:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (ffff9e2f90226e00) 00010000:00010000:2.0:1779690600.272554:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.272557:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272562:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a191405af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272593:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ab expref: 60 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272616:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:2.0:1779690600.272618:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.272622:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ab expref: 60 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.272631:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2ca00, rc 0) 00000100:00100000:2.0:1779690600.272700:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+59:112313:x1866137503820416:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 761us (3701us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690600.272707:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1145 00000100:00100000:3.0:1779690600.276793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690600.276970:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820672 00000100:00100000:0.0:1779690600.276985:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820672 00000100:00100000:0.0:1779690600.277071:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1146 00000100:00100000:0.0:1779690600.277083:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+59:112313:x1866137503820672:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690600.277140:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690600.277168:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a1914059a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4a4 expref: 59 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.277188:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:0.0:1779690600.277193:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690600.277500:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.277515:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.277524:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.277558:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 54 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.277571:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 54 pid: 57559 timeout: 3427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690600.277586:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83692300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492368128:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690600.277693:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e3089b47000 going to sleep for 11 seconds 00000100:00100000:1.0:1779690600.280927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690600.281043:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83692300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492368128:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690600.281070:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690600.281169:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820800 00000100:00100000:2.0:1779690600.281178:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820800 00010000:00010000:2.0:1779690600.281210:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 55 pid: 57559 timeout: 3427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690600.281253:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3334 00000100:00100000:2.0:1779690600.281263:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+55:2391:x1866137503820800:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690600.281277:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690600.281284:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 55 pid: 57559 timeout: 3427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281296:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 55 pid: 57559 timeout: 3427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281317:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140569 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee496 expref: 55 pid: 57559 timeout: 3427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281346:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:2.0:1779690600.281351:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281360:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281367:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.281398:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690600.281460:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+54:2391:x1866137503820800:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 198us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.281467:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3334 00010000:00010000:0.0:1779690600.281594:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.281602:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.281627:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.281636:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.281643:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690600.282842:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00010000:00010000:0.0:1779690600.282855:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282863:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282870:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282876:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690600.282881:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282888:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282913:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226900) 00010000:00010000:0.0:1779690600.282916:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690600.282920:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.282926:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191405b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690600.282945:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4e7938f reply state 000000008a2d5e93 transno 12884902422 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690600.282953:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690600.283024:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+60:112313:x1866137503820672:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 5941us (6241us total) trans 12884902422 rc 0/0 00000100:00100000:0.0:1779690600.283032:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1146 00010000:00010000:0.0:1779690600.287523:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287540:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287547:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287553:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690600.287557:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287565:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287599:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690600.287602:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690600.287607:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.287614:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191405bd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690600.326515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.327183:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503820928 00000100:00100000:2.0:1779690600.327194:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503820928 00000100:00100000:2.0:1779690600.327257:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1147 00000100:00100000:2.0:1779690600.327269:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:112317:x1866137503820928:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690600.327287:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.327308:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a191405c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4b2 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327372:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327386:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327415:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690600.327533:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1779690600.327538:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690600.327562:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327586:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a191405c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b2 expref: 56 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327604:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b2 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.327612:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:2.0:1779690600.327615:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690600.327619:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2ca00, rc 0) 00000100:00100000:2.0:1779690600.327743:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+55:112317:x1866137503820928:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 476us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.327750:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1147 00000100:00100000:3.0:1779690600.337953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690600.338007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.338075:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821056 00000100:00100000:2.0:1779690600.338087:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821056 00000100:00100000:2.0:1779690600.338149:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821312 00000100:00100000:2.0:1779690600.338153:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821312 00000100:00100000:2.0:1779690600.338196:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1148 00000100:00100000:2.0:1779690600.338207:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+56:2392:x1866137503821056:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:2.0:1779690600.338256:0:57560:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2257846272 avail 2255749120 00000100:00100000:3.0:1779690600.338286:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1149 00000100:00100000:3.0:1779690600.338305:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:112317:x1866137503821312:12345-192.168.203.5@tcp:36:mkdir.0 00000100:00100000:2.0:1779690600.338333:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+56:2392:x1866137503821056:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 125us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.338354:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1148 00010000:00010000:3.0:1779690600.338370:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690600.338408:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a191405cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b2 expref: 55 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.338451:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690600.338467:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690600.338921:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+54:112317:x1866137503821312:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 623us (912us total) trans 0 rc -17/-17 00000100:00100000:3.0:1779690600.338930:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1149 00000100:00100000:3.0:1779690600.343367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.343498:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821440 00000100:00100000:1.0:1779690600.343511:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821440 00000100:00100000:1.0:1779690600.343704:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1150 00000100:00100000:1.0:1779690600.343716:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+54:112317:x1866137503821440:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690600.343754:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.343781:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191405d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4b9 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344050:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344069:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344083:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.344239:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690600.344244:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.344273:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344302:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191405d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 56 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344326:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 55 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.344335:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690600.344339:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690600.344343:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871000, rc 0) 00000100:00100000:1.0:1779690600.344465:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+55:112317:x1866137503821440:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 750us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.344481:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1150 00000100:00100000:2.0:1779690600.351606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.351769:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821568 00000100:00100000:1.0:1779690600.351783:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821568 00000100:00100000:1.0:1779690600.351884:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1151 00000100:00100000:1.0:1779690600.351897:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+55:112317:x1866137503821568:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690600.351923:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.351950:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191405e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4c0 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352642:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352681:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352695:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352712:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352719:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352737:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352918:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352927:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.352935:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.352984:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:1.0:1779690600.352990:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.353029:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353044:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353064:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353071:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353076:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.353081:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353088:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353101:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690600.353104:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.353110:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353398:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191405e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353427:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353434:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353440:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353445:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.353454:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353460:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353469:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (ffff9e2f90442100) 00010000:00010000:1.0:1779690600.353472:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.353475:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353481:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191405ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353616:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191405e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4c0 expref: 57 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353633:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4c0 expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.353641:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:1.0:1779690600.353644:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690600.353646:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870200, rc 0) 00000100:00100000:1.0:1779690600.353736:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+56:112317:x1866137503821568:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1842us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.353745:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1151 00000100:00100000:2.0:1779690600.368288:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690600.368404:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821696 00000100:00100000:3.0:1779690600.368417:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821696 00000100:00100000:3.0:1779690600.368513:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1152 00000100:00100000:3.0:1779690600.368524:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:112318:x1866137503821696:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:3.0:1779690600.368552:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690600.368576:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a191405fc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4c7 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368668:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368686:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368699:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368715:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368732:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368753:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368910:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368918:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368924:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368930:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690600.368934:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368942:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368955:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:3.0:1779690600.368958:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.368964:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368970:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140603 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368982:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.368988:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369019:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369024:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ac00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690600.369027:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369033:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369041:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xd86b4ffe (ffff9e2f905ad000) 00010000:00010000:3.0:1779690600.369043:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.369046:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369052:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a1914060a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369089:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a191405fc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4c7 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369100:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:3.0:1779690600.369102:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.369106:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a191405fc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4c7 expref: 57 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.369127:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4a200, rc 0) 00000100:00100000:3.0:1779690600.369204:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+56:112318:x1866137503821696:12345-192.168.203.5@tcp:101:rm.0 Request processed in 681us (930us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690600.369221:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1152 00000100:00100000:3.0:1779690600.383107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.384097:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503821952 00000100:00100000:1.0:1779690600.384118:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503821952 00000100:00100000:1.0:1779690600.384194:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1153 00000100:00100000:1.0:1779690600.384206:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+56:112319:x1866137503821952:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:1.0:1779690600.384252:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.384255:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1779690600.384290:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a191405f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4c0 expref: 56 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384315:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:1.0:1779690600.384329:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690600.384347:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140611 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4ce expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384507:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384522:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384532:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384544:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384550:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.384556:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690600.387252:0:64445:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f3:0x0], index 0: 0 00010000:00010000:1.0:1779690600.387439:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871800/0xb4bb873a19140626 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387462:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871800/0xb4bb873a19140626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387474:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871800/0xb4bb873a19140626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387507:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387514:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387520:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387527:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.387531:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387538:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387889:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:1.0:1779690600.387892:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.387897:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387904:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140618 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690600.387919:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000616ae606 reply state 00000000ddd86307 transno 12884902423 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690600.387933:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1779690600.387968:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140611 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ce expref: 58 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387986:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871800/0xb4bb873a19140626 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ce expref: 57 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.387993:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:1.0:1779690600.387996:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690600.387998:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871800, rc 0) 00000100:00100000:1.0:1779690600.388071:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:112319:x1866137503821952:12345-192.168.203.5@tcp:101:dd.0 Request processed in 3867us (4978us total) trans 12884902423 rc 0/0 00000100:00100000:1.0:1779690600.388079:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1153 00010000:00010000:2.0:1779690600.390880:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390897:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390905:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390911:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.390916:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390923:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390940:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xd86b4ffe (ffff9e2f90442200) 00010000:00010000:2.0:1779690600.390943:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.390947:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.390953:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a1914061f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690600.393561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.393697:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503822208 00000100:00100000:2.0:1779690600.393710:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503822208 00000100:00100000:2.0:1779690600.394122:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:2.0:1779690600.394146:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+57:112319:x1866137503822208:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:2.0:1779690600.394694:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+58:112319:x1866137503822208:12345-192.168.203.5@tcp:35:dd.0 Request processed in 546us (1141us total) trans 12884902424 rc 0/0 00000100:00100000:2.0:1779690600.394703:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:1.0:1779690600.416961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690600.418224:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503822336 00000100:00100000:0.0:1779690600.418243:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503822336 00000100:00100000:0.0:1779690600.418329:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1154 00000100:00100000:0.0:1779690600.418342:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:112320:x1866137503822336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690600.418371:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690600.418399:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4d5 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418482:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418500:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418513:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418529:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418537:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418563:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418714:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140649 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418736:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418744:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690600.418786:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:0.0:1779690600.418791:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690600.418869:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418883:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418890:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418898:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418903:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690600.418908:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.418916:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420059:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:0.0:1779690600.420067:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690600.420075:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420084:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a1914063b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420103:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420110:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420116:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420122:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690600.420126:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420132:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420140:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690600.420142:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690600.420145:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420151:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420215:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4d5 expref: 60 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420231:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282200/0xb4bb873a19140649 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4d5 expref: 59 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.420239:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690600.420241:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1779690600.420244:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282200, rc 0) 00000100:00100000:0.0:1779690600.420337:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:112320:x1866137503822336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1996us (3385us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690600.420348:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1154 00000100:00100000:3.0:1779690600.446402:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.446560:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503822464 00000100:00100000:2.0:1779690600.446574:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503822464 00000100:00100000:2.0:1779690600.447014:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1155 00000100:00100000:2.0:1779690600.447028:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:112325:x1866137503822464:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690600.447054:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.447077:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4dc expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447151:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447166:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447177:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690600.447255:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:2.0:1779690600.447260:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690600.447288:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447318:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4dc expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447364:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4dc expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.447373:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.447376:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690600.447380:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2cc00, rc 0) 00000100:00100000:2.0:1779690600.447515:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+60:112325:x1866137503822464:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 490us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.447524:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1155 00000100:00100000:3.0:1779690600.457707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.457855:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503822592 00000100:00100000:1.0:1779690600.457868:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503822592 00000100:00100000:1.0:1779690600.457935:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1156 00000100:00100000:1.0:1779690600.457946:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:112326:x1866137503822592:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690600.457971:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.457994:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914065e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4e3 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458067:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458084:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458116:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458132:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458139:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458146:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458218:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458225:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458231:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458237:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.458242:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458249:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458262:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690600.458265:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.458270:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458282:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140665 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458300:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458305:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458311:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458316:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.458318:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458324:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458330:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xa2905c76 (ffff9e2f90442100) 00010000:00010000:1.0:1779690600.458332:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.458335:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458339:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a1914066c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458373:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914065e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4e3 expref: 61 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458393:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690600.458395:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.458399:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914065e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4e3 expref: 61 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.458408:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871e00, rc 0) 00000100:00100000:1.0:1779690600.458511:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:112326:x1866137503822592:12345-192.168.203.5@tcp:101:rm.0 Request processed in 566us (817us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690600.458519:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1156 00000100:00100000:1.0:1779690600.473419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690600.473843:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503822848 00000100:00100000:0.0:1779690600.474329:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503822848 00000100:00100000:2.0:1779690600.474512:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1157 00000100:00100000:2.0:1779690600.474528:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+60:112327:x1866137503822848:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1779690600.474555:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.474559:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690600.474595:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140657 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4dc expref: 60 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.474618:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.474625:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690600.474640:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140673 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4ea expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475186:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475208:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475344:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475362:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475370:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.475377:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690600.476000:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f3:0x0], index 1: 0 00010000:00010000:2.0:1779690600.476230:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140688 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476243:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140688 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476252:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140688 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476297:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476305:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476313:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476319:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.476330:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476338:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476350:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.476354:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.476359:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476366:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914067a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690600.476380:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000490e6658 reply state 00000000f490b56c transno 12884902425 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690600.476391:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690600.476434:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140673 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ea expref: 62 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476449:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c200/0xb4bb873a19140688 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ea expref: 61 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.476457:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2d:0x0].0x0 (ffff9e2f90226c00) 00010000:00010000:2.0:1779690600.476459:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690600.476461:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c200, rc 0) 00000100:00100000:2.0:1779690600.476560:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+62:112327:x1866137503822848:12345-192.168.203.5@tcp:101:dd.0 Request processed in 2037us (3154us total) trans 12884902425 rc 0/0 00000100:00100000:2.0:1779690600.476569:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1157 00010000:00010000:0.0:1779690600.478261:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478370:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478378:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478386:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2de00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690600.478391:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478400:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478432:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xa2905c76 (ffff9e2f90226f00) 00010000:00010000:0.0:1779690600.478435:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690600.478441:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690600.478448:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140681 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690600.481866:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690600.481904:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503823104 00000100:00100000:0.0:1779690600.481916:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503823104 00000100:00100000:0.0:1779690600.481989:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:0.0:1779690600.482000:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+61:112327:x1866137503823104:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690600.482445:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+62:112327:x1866137503823104:12345-192.168.203.5@tcp:35:dd.0 Request processed in 445us (590us total) trans 12884902426 rc 0/0 00000100:00100000:0.0:1779690600.482455:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:3.0:1779690600.529265:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.530228:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503823232 00000100:00100000:2.0:1779690600.530245:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503823232 00000100:00100000:2.0:1779690600.530335:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1158 00000100:00100000:2.0:1779690600.530349:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+62:112333:x1866137503823232:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690600.530393:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.530423:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4f1 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530506:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530527:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530544:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690600.530620:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:2.0:1779690600.530626:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690600.530653:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530689:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4f1 expref: 64 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530714:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4f1 expref: 63 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.530731:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.530734:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690600.530749:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c400, rc 0) 00000100:00100000:2.0:1779690600.530873:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112333:x1866137503823232:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 526us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690600.530880:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1158 00000100:00100000:3.0:1779690600.544707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.544973:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503823360 00000100:00100000:2.0:1779690600.544986:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503823360 00000100:00100000:2.0:1779690600.545122:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1159 00000100:00100000:2.0:1779690600.545133:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:112334:x1866137503823360:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690600.545158:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.545192:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4f8 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545393:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545412:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545425:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545441:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545449:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545456:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545598:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545624:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545631:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545638:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.545643:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545651:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545664:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.545666:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.545671:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545676:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ab lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545692:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545698:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545704:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545709:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.545726:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545734:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545742:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x9838e759 (ffff9e2f90226100) 00010000:00010000:2.0:1779690600.545745:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.545748:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545753:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.545793:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4f8 expref: 64 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.546112:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.546116:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.546121:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4f8 expref: 64 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.546133:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d200, rc 0) 00000100:00100000:2.0:1779690600.546219:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:112334:x1866137503823360:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1087us (1525us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690600.546234:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1159 00000100:00100000:3.0:1779690600.557562:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.557764:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503823616 00000100:00100000:2.0:1779690600.557777:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503823616 00000100:00100000:2.0:1779690600.557894:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1160 00000100:00100000:2.0:1779690600.557906:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:112335:x1866137503823616:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1779690600.557949:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.557953:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690600.557988:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a1914069d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4f1 expref: 63 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558012:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.558022:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690600.558037:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee4ff expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558408:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558426:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558437:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558453:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558460:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.558465:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690600.559302:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f4:0x0], index 0: 0 00010000:00010000:2.0:1779690600.559527:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559547:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559557:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559640:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559649:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559656:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559663:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.559668:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559676:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559688:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.559691:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.559696:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559701:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690600.559715:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021e2ee9f reply state 0000000011ceeb85 transno 12884902427 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690600.559745:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690600.559784:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559798:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 64 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.559837:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:2.0:1779690600.559840:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690600.559842:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2ce00, rc 0) 00000100:00100000:2.0:1779690600.559982:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+65:112335:x1866137503823616:12345-192.168.203.5@tcp:101:dd.0 Request processed in 2078us (2436us total) trans 12884902427 rc 0/0 00000100:00100000:2.0:1779690600.559992:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1160 00010000:00010000:2.0:1779690600.561678:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561696:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561879:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561888:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.561892:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561901:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561938:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x9838e759 (ffff9e2f90226100) 00010000:00010000:2.0:1779690600.561942:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.561948:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.561954:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690600.563372:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.564290:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503823872 00000100:00100000:2.0:1779690600.564303:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503823872 00000100:00100000:2.0:1779690600.564374:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:2.0:1779690600.564385:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+64:112335:x1866137503823872:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:2.0:1779690600.565271:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+65:112335:x1866137503823872:12345-192.168.203.5@tcp:35:dd.0 Request processed in 883us (1904us total) trans 12884902428 rc 0/0 00000100:00100000:2.0:1779690600.565282:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:3.0:1779690600.612709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.613254:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824000 00000100:00100000:1.0:1779690600.613273:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824000 00000100:00100000:1.0:1779690600.613367:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1161 00000100:00100000:1.0:1779690600.613394:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+65:112341:x1866137503824000:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:1.0:1779690600.613445:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.613473:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191406dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee506 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613544:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613566:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613582:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.613682:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:1.0:1779690600.613689:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.613736:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613767:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191406dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee506 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613924:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee506 expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.613937:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690600.613941:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690600.613944:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871200, rc 0) 00000100:00100000:1.0:1779690600.614025:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+66:112341:x1866137503824000:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 647us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.614033:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1161 00000100:00100000:3.0:1779690600.625247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.625938:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824128 00000100:00100000:2.0:1779690600.625952:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824128 00000100:00100000:2.0:1779690600.626020:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1162 00000100:00100000:2.0:1779690600.626030:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+66:112342:x1866137503824128:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690600.626056:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.626081:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee50d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626165:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626183:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626210:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626226:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626233:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626240:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626319:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626327:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626334:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626340:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.626344:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626352:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626364:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.626367:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.626372:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626385:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a191406f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626406:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626412:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626419:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626424:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.626427:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626432:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626440:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x1313e569 (ffff9e2f90226100) 00010000:00010000:2.0:1779690600.626442:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.626445:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626452:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191406f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626485:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ea lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee50d expref: 67 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626506:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.626509:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.626513:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee50d expref: 67 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.626523:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2cc00, rc 0) 00000100:00100000:2.0:1779690600.626605:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+66:112342:x1866137503824128:12345-192.168.203.5@tcp:101:rm.0 Request processed in 576us (1373us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690600.626613:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1162 00000100:00100000:3.0:1779690600.635973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690600.636666:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824384 00000100:00100000:2.0:1779690600.636679:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824384 00000100:00100000:2.0:1779690600.636759:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1163 00000100:00100000:2.0:1779690600.636771:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:112343:x1866137503824384:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1779690600.636799:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690600.636848:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1779690600.636888:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191406e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee506 expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.636917:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.636923:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690600.636941:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ff lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee514 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637097:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637133:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637143:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637158:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637164:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.637170:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1779690600.639970:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f4:0x0], index 1: 0 00010000:00010000:2.0:1779690600.640180:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640198:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640210:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640242:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640249:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640255:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640270:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690600.640274:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640281:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640294:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690600.640297:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690600.640301:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640308:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140706 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1779690600.640323:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004e2c74a2 reply state 00000000093f35f4 transno 12884902429 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690600.640332:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1779690600.640367:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a191406ff lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640380:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 67 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690600.640388:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:2.0:1779690600.640390:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690600.640392:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c400, rc 0) 00000100:00100000:2.0:1779690600.640465:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+68:112343:x1866137503824384:12345-192.168.203.5@tcp:101:dd.0 Request processed in 3696us (4504us total) trans 12884902429 rc 0/0 00000100:00100000:2.0:1779690600.640493:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1163 00000100:00100000:0.0:1779690600.643705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.643837:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824640 00000100:00100000:1.0:1779690600.643846:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824640 00000100:00100000:1.0:1779690600.643894:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:1.0:1779690600.643903:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+68:112343:x1866137503824640:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:1.0:1779690600.644257:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+69:112343:x1866137503824640:12345-192.168.203.5@tcp:35:dd.0 Request processed in 353us (559us total) trans 12884902430 rc 0/0 00000100:00100000:1.0:1779690600.644265:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 164 00010000:00010000:3.0:1779690600.644589:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644601:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644609:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644615:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690600.644619:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644626:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644642:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x1313e569 (ffff9e2f90226100) 00010000:00010000:3.0:1779690600.644656:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.644661:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.644668:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a1914070d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690600.686627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.686715:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824768 00000100:00100000:1.0:1779690600.686732:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824768 00000100:00100000:1.0:1779690600.686837:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1164 00000100:00100000:1.0:1779690600.686848:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+59:112346:x1866137503824768:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690600.686889:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.686909:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee51b expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.686980:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.686996:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.687008:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.687071:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690600.687074:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 114 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.687091:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.687108:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a19140722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee51b expref: 61 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.687160:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee51b expref: 60 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.687167:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:1.0:1779690600.687169:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690600.687622:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870200, rc 0) 00000100:00100000:1.0:1779690600.687685:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+60:112346:x1866137503824768:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 839us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.687701:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1164 00000100:00100000:0.0:1779690600.692336:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690600.692415:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503824896 00000100:00100000:3.0:1779690600.692425:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503824896 00000100:00100000:3.0:1779690600.692484:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1165 00000100:00100000:3.0:1779690600.692495:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+60:112346:x1866137503824896:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690600.692514:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690600.692534:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee522 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692596:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692612:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692623:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692638:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692645:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692651:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692789:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b400/0xb4bb873a19140745 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.692798:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b400/0xb4bb873a19140745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693481:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b400/0xb4bb873a19140745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690600.693523:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:3.0:1779690600.693526:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690600.693548:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b400/0xb4bb873a19140745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693559:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693566:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693573:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693578:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ac00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690600.693582:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693588:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693599:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690600.693610:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.693616:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693622:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a19140737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693635:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693640:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693646:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693651:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690600.693654:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693660:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693668:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690600.693670:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690600.693672:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693677:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a1914073e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.693708:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee522 expref: 62 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.694480:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b400/0xb4bb873a19140745 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee522 expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690600.694489:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:3.0:1779690600.694491:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690600.694495:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b400, rc 0) 00000100:00100000:3.0:1779690600.694565:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+61:112346:x1866137503824896:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2072us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690600.694573:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1165 00000100:00100000:0.0:1779690600.696596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.696692:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825024 00000100:00100000:1.0:1779690600.696700:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825024 00000100:00100000:1.0:1779690600.696761:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1166 00000100:00100000:1.0:1779690600.696770:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+61:112346:x1866137503825024:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690600.696789:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.696837:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914074c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee529 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696910:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696923:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696935:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696948:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696954:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.696960:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697052:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697075:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697081:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.697110:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00000004:00200000:1.0:1779690600.697114:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.697128:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697140:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697148:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697155:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697161:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697166:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.697176:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697183:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697192:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690600.697199:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.697204:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697210:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140753 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697225:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697230:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697237:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697246:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690600.697249:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697254:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697262:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x9838e759 (ffff9e2f90442100) 00010000:00010000:1.0:1779690600.697264:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690600.697267:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697273:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914075a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697305:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914074c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 63 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697325:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 62 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.697332:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690600.697335:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690600.697337:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870600, rc 0) 00000100:00100000:1.0:1779690600.697385:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+62:112346:x1866137503825024:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 615us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.697392:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1166 00000100:00100000:0.0:1779690600.702525:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.703988:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825152 00000100:00100000:1.0:1779690600.704000:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825152 00000100:00100000:1.0:1779690600.704081:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6515 00000100:00100000:1.0:1779690600.704092:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503825152:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690600.704110:0:49882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.704130:0:49882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee530 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690600.704157:0:49882:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690600.704175:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690600.704177:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690600.704185:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.704204:0:49882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.704238:0:49882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870400, rc 0) 00000100:00100000:1.0:1779690600.704290:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+18:2389:x1866137503825152:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 199us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.704297:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6515 00000100:00100000:0.0:1779690600.709440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690600.709704:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825280 00000100:00100000:1.0:1779690600.709713:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825280 00000100:00100000:1.0:1779690600.709783:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1167 00000100:00100000:1.0:1779690600.709793:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+62:112346:x1866137503825280:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690600.709845:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690600.709865:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914076f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee537 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.709933:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.709948:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.709958:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690600.710017:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 512 00000004:00200000:1.0:1779690600.710021:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690600.710056:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.710080:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a1914076f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.710119:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 63 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690600.710127:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690600.710130:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690600.710133:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871c00, rc 0) 00000100:00100000:1.0:1779690600.710417:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+63:112346:x1866137503825280:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 624us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690600.710425:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1167 00000100:00100000:0.0:1779690600.714648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690600.715115:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825536 00000100:00100000:3.0:1779690600.715125:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825536 00000100:00100000:3.0:1779690600.715217:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1168 00000100:00100000:3.0:1779690600.715228:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+63:112346:x1866137503825536:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690600.715567:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].44, 136 off14176 00000100:00100000:3.0:1779690600.715661:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+63:112346:x1866137503825536:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 435us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690600.715669:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1168 00010000:00010000:1.0:1779690600.905018:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690601.097166:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690601.097175:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690601.097427:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 45 count 9 00000040:00080000:2.0:1779690601.097435:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690601.097661:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492368256:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690601.098275:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bee5f240 going to sleep for 11 seconds 00000100:00100000:0.0:1779690601.101950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.102014:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492368256:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690601.102154:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825664 00000100:00100000:1.0:1779690601.102161:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825664 00000100:00100000:1.0:1779690601.102238:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1169 00000100:00100000:1.0:1779690601.102249:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:112356:x1866137503825664:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1779690601.102277:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1779690601.102279:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690601.102393:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:112356:x1866137503825664:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 146us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690601.102400:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1169 00000100:00100000:0.0:1779690601.105944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690601.106135:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503825920 00000100:00100000:1.0:1779690601.106145:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503825920 00000100:00100000:1.0:1779690601.106209:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1170 00000100:00100000:1.0:1779690601.106219:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+68:112356:x1866137503825920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690601.106240:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690601.106258:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a1914077d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee53e expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.106375:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140784 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.106392:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.106405:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690601.106418:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00010000:00010000:1.0:1779690601.106542:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a1914077d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee53e expref: 71 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.106577:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140784 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee53e expref: 70 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.106588:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690601.106591:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690601.106595:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870a00, rc 0) 00000100:00100000:1.0:1779690601.106656:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503825920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 438us (719us total) trans 12884902431 rc 0/0 00000100:00100000:1.0:1779690601.106663:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1170 00000100:00100000:0.0:1779690601.109769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.110179:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826048 00000100:00100000:3.0:1779690601.110189:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826048 00000100:00100000:3.0:1779690601.110318:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6516 00000100:00100000:3.0:1779690601.110327:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503826048:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690601.110365:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110399:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.110401:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.110406:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110420:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110449:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110458:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110466:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110473:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690601.110477:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110485:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110499:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.110513:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2a12b9/0xb4bb873a19140792 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690601.110586:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503826048:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 260us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.110786:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6516 00000100:00100000:0.0:1779690601.110944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.111101:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826176 00000100:00100000:3.0:1779690601.111106:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826176 00000100:00100000:3.0:1779690601.111144:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18688 00000100:00100000:3.0:1779690601.111152:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+70:2392:x1866137503826176:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690601.111162:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690601.111179:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140784 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee53e expref: 70 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.111195:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:3.0:1779690601.111200:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690601.111266:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+69:2392:x1866137503826176:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.111273:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18688 00000100:00080000:2.0:1779690601.111405:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690601.112617:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.112671:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826432 00000100:00100000:3.0:1779690601.112676:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826432 00000100:00100000:3.0:1779690601.112757:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1171 00000100:00100000:3.0:1779690601.112765:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+69:112356:x1866137503826432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690601.112883:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+69:112356:x1866137503826432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.112902:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1171 00000100:00100000:1.0:1779690601.116166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.116232:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826560 00000100:00100000:3.0:1779690601.116241:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826560 00000100:00100000:3.0:1779690601.116287:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6517 00000100:00100000:3.0:1779690601.116296:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503826560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690601.116311:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690601.116326:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee545 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.116348:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.116349:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.116356:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 8 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.116371:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 8 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.116384:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4a000, rc 0) 00000100:00100000:3.0:1779690601.116432:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503826560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 137us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.116439:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6517 00000100:00100000:1.0:1779690601.122555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690601.122761:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826816 00000100:00100000:0.0:1779690601.122768:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826816 00000100:00100000:0.0:1779690601.122838:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1172 00000100:00100000:0.0:1779690601.122848:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+69:112356:x1866137503826816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690601.122940:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+69:112356:x1866137503826816:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690601.122949:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1172 00000100:00100000:1.0:1779690601.128233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.128633:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503826944 00000100:00100000:3.0:1779690601.128644:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503826944 00000100:00100000:3.0:1779690601.128707:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1173 00000100:00100000:3.0:1779690601.128727:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+69:112356:x1866137503826944:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690601.128758:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690601.128778:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a191407a0 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee54c expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129081:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129097:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129108:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129212:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a191407a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 71 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129230:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 70 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.129249:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:3.0:1779690601.129253:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690601.129257:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4ac00, rc 0) 00000100:00100000:3.0:1779690601.129324:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503826944:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 608us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.129331:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1173 00000100:00100000:3.0:1779690601.137246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.137280:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827072 00000100:00100000:3.0:1779690601.137328:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827072 00000100:00100000:3.0:1779690601.137377:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1174 00000100:00100000:3.0:1779690601.137396:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503827072:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690601.137425:0:57561:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690601.137522:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503827072:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 129us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.137530:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1174 00000100:00100000:1.0:1779690601.139682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.139747:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827200 00000100:00100000:3.0:1779690601.139755:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827200 00000100:00100000:3.0:1779690601.139822:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6518 00000100:00100000:3.0:1779690601.139841:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503827200:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690601.139878:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139894:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.139896:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690601.139901:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139915:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139942:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139951:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139959:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139972:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4be00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690601.139977:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.139986:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.140001:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690601.140008:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c383c017/0xb4bb873a191407ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690601.140069:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503827200:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 231us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.140076:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6518 00000100:00100000:3.0:1779690601.141685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690601.142441:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827456 00000100:00100000:0.0:1779690601.142450:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827456 00000100:00100000:0.0:1779690601.142545:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1175 00000100:00100000:0.0:1779690601.142556:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503827456:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1779690601.142637:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.142655:0:57560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 70 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.142664:0:57560:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.142697:0:57560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 70 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.142711:0:57560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 70 pid: 64445 timeout: 3428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690601.142738:0:57560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492368384:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690601.142861:0:57560:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f82f91240 going to sleep for 11 seconds 00000100:00100000:0.0:1779690601.146006:0:57560:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:57560:1866137492368384:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690601.146041:0:57560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690601.146544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690601.146763:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827584 00000100:00100000:2.0:1779690601.146770:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827584 00010000:00010000:2.0:1779690601.146801:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 71 pid: 64445 timeout: 3428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690601.146851:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3335 00000100:00100000:2.0:1779690601.146860:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+71:2391:x1866137503827584:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690601.146873:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690601.146879:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 71 pid: 64445 timeout: 3428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146890:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 71 pid: 64445 timeout: 3428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146912:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ac00/0xb4bb873a191407a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee54c expref: 71 pid: 64445 timeout: 3428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146925:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:2.0:1779690601.146936:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146946:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146953:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690601.146984:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690601.147020:0:57560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147028:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690601.147039:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+70:2391:x1866137503827584:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 180us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690601.147046:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3335 00010000:00010000:0.0:1779690601.147256:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147265:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147272:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147279:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690601.147283:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147291:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147302:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:0.0:1779690601.147305:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690601.147309:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690601.147315:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191407b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690601.147460:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503827456:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 4905us (5779us total) trans 12884902432 rc 0/0 00000100:00100000:0.0:1779690601.147469:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1175 00000040:00080000:2.0:1779690601.147548:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690601.147552:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690601.148084:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 9 00000040:00080000:2.0:1779690601.148095:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690601.150872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690601.151550:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827840 00000100:00100000:1.0:1779690601.151558:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827840 00000100:00100000:1.0:1779690601.151599:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:1.0:1779690601.151609:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+70:112356:x1866137503827840:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690601.151935:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+71:112356:x1866137503827840:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 327us (1069us total) trans 12884902433 rc 0/0 00000100:00100000:1.0:1779690601.151943:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 165 00000040:00080000:1.0:1779690601.210682:0:73381:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690601.210690:0:73381:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690601.210770:0:73381:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 45 count 9 00000040:00080000:1.0:1779690601.210776:0:73381:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690601.248512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690601.248549:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503827968 00000100:00100000:1.0:1779690601.248558:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503827968 00000100:00100000:1.0:1779690601.248613:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1176 00000100:00100000:1.0:1779690601.248622:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+63:112357:x1866137503827968:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690601.248641:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690601.248662:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191407bc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee553 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.248842:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.248858:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.248868:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249027:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249035:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249042:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249135:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249144:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249152:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690601.249184:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2f:0x0]: returning size 0 00000004:00200000:1.0:1779690601.249188:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690601.249206:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249217:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249225:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249232:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249249:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249255:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690601.249259:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.249268:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250183:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690601.250189:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690601.250195:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250204:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a191407c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250221:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250227:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250233:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250239:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690601.250242:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250258:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250268:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x1313e569 (ffff9e2f90442100) 00010000:00010000:1.0:1779690601.250271:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690601.250274:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250684:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a191407ca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250795:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a191407bc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250842:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 64 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.250851:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:1.0:1779690601.250853:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690601.250856:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871200, rc 0) 00000100:00080000:2.0:1779690601.250872:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690601.251448:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+64:112357:x1866137503827968:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2823us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690601.251457:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1176 00000100:00100000:2.0:1779690601.256550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690601.258065:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828096 00000100:00100000:1.0:1779690601.258078:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828096 00000100:00080000:2.0:1779690601.258143:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690601.258184:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6519 00000100:00100000:1.0:1779690601.258196:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503828096:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690601.258586:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690601.258612:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee55a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690601.258639:0:6582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690601.258663:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690601.258666:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690601.258675:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.258693:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690601.258706:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870a00, rc 0) 00000100:00100000:1.0:1779690601.258781:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503828096:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 587us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690601.258789:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6519 00000100:00100000:0.0:1779690601.266319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690601.266439:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828352 00000100:00100000:3.0:1779690601.266448:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828352 00000100:00100000:3.0:1779690601.267190:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1177 00000100:00100000:3.0:1779690601.267203:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+64:112357:x1866137503828352:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690601.267533:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].45, 136 off14312 00000100:00100000:3.0:1779690601.267629:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+64:112357:x1866137503828352:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 428us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690601.267638:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1177 00000040:00080000:0.0:1779690601.827419:0:73432:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690601.827427:0:73432:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690601.827523:0:73432:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 46 count 10 00000040:00080000:0.0:1779690601.827528:0:73432:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690601.929288:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690601.961003:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968462 is committed 00000040:00080000:2.0:1779690602.185082:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690602.185090:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690602.185132:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 46 count 10 00000040:00080000:2.0:1779690602.185140:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690602.185403:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492368512:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690602.185692:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e309d8c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690602.190105:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492368512:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690602.190133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690602.190325:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828480 00000100:00100000:0.0:1779690602.190333:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828480 00000100:00100000:0.0:1779690602.190462:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1178 00000100:00100000:0.0:1779690602.190473:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+71:112377:x1866137503828480:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1779690602.190507:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1779690602.192302:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+71:112377:x1866137503828480:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 1823us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.192314:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1178 00000100:00100000:0.0:1779690602.196536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690602.196634:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828736 00000100:00100000:1.0:1779690602.196643:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828736 00000100:00100000:1.0:1779690602.196742:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1179 00000100:00100000:1.0:1779690602.196753:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+71:112377:x1866137503828736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690602.196778:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690602.196799:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191407df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee561 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.196931:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a191407e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.196957:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a191407e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.196969:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a191407e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690602.196982:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2f:0x0]: returning size 0 00010000:00010000:1.0:1779690602.197107:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a191407df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee561 expref: 74 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.197127:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a191407e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee561 expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.197135:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:1.0:1779690602.197138:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690602.197142:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871400, rc 0) 00000100:00100000:1.0:1779690602.197208:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503828736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 457us (679us total) trans 12884902434 rc 0/0 00000100:00100000:1.0:1779690602.197216:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1179 00000100:00100000:1.0:1779690602.201849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.201957:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828864 00000100:00100000:3.0:1779690602.201966:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828864 00000100:00100000:3.0:1779690602.202088:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6520 00000100:00100000:3.0:1779690602.202100:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503828864:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690602.202157:0:40949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202174:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690602.202176:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690602.202181:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202194:0:40949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202222:0:40949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202230:0:40949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202237:0:40949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202275:0:40949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4be00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690602.202280:0:40949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202289:0:40949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202311:0:40949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.202319:0:40949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690602.202389:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503828864:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 291us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.202396:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6520 00000100:00080000:0.0:1779690602.202652:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690602.204998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.205167:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503828992 00000100:00100000:3.0:1779690602.205176:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503828992 00000100:00100000:3.0:1779690602.205287:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18689 00000100:00100000:3.0:1779690602.205296:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+73:2390:x1866137503828992:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690602.205311:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690602.205335:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a191407e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee561 expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.205357:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690602.205369:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690602.205511:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+72:2390:x1866137503828992:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 215us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.205519:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18689 00000100:00100000:2.0:1779690602.207248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.207320:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503829248 00000100:00100000:3.0:1779690602.207423:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503829248 00000100:00100000:3.0:1779690602.207518:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1180 00000100:00100000:3.0:1779690602.207527:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+72:112377:x1866137503829248:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690602.207639:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+72:112377:x1866137503829248:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 112us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.207647:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1180 00000100:00100000:1.0:1779690602.218605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.218734:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503829376 00000100:00100000:3.0:1779690602.218743:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503829376 00000100:00100000:3.0:1779690602.218794:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6521 00000100:00100000:3.0:1779690602.218849:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503829376:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690602.218867:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690602.218884:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee568 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.218909:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690602.218912:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690602.218920:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.218936:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.218969:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4be00, rc 0) 00000100:00100000:3.0:1779690602.219033:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503829376:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 230us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.219041:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6521 00000100:00100000:2.0:1779690602.231051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690602.231919:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503829632 00000100:00100000:0.0:1779690602.231931:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503829632 00000100:00100000:0.0:1779690602.231994:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1181 00000100:00100000:0.0:1779690602.232005:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+72:112377:x1866137503829632:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690602.232112:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+72:112377:x1866137503829632:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 109us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.232120:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1181 00000100:00100000:2.0:1779690602.244357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690602.244447:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503829760 00000100:00100000:1.0:1779690602.244457:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503829760 00000100:00100000:1.0:1779690602.244514:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1182 00000100:00100000:1.0:1779690602.244525:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+72:112377:x1866137503829760:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690602.244547:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690602.244566:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140802 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee56f expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244618:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244632:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244643:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244747:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140802 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 74 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244770:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690602.244778:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:1.0:1779690602.244781:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690602.244784:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871600, rc 0) 00000100:00100000:1.0:1779690602.244907:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503829760:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 383us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690602.244914:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1182 00000100:00100000:1.0:1779690602.248528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.248784:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503829888 00000100:00100000:3.0:1779690602.248795:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503829888 00000100:00100000:3.0:1779690602.249188:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1183 00000100:00100000:3.0:1779690602.249200:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503829888:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690602.249232:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690602.249334:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503829888:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 137us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.249341:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1183 00000100:00100000:3.0:1779690602.254503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690602.254603:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503830016 00000100:00100000:0.0:1779690602.254613:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503830016 00000100:00100000:0.0:1779690602.254673:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6522 00000100:00100000:0.0:1779690602.254683:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503830016:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690602.254738:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254755:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690602.254757:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690602.254762:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254775:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254842:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254852:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254859:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254867:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690602.254871:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254894:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254909:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.254916:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a19140810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690602.254980:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503830016:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 299us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.254988:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6522 00000100:00100000:2.0:1779690602.256739:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.256975:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503830272 00000100:00100000:3.0:1779690602.256983:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503830272 00000100:00100000:3.0:1779690602.257071:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1184 00000100:00100000:3.0:1779690602.257082:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503830272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690602.257155:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.257182:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.257192:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.257236:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 73 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.257249:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 73 pid: 64445 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690602.257263:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492368640:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690602.257354:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138c00 going to sleep for 11 seconds 00000100:00100000:1.0:1779690602.263989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690602.264012:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492368640:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690602.264048:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690602.264108:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503830400 00000100:00100000:0.0:1779690602.264115:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503830400 00010000:00010000:0.0:1779690602.264212:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 74 pid: 64445 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690602.264282:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3336 00000100:00100000:0.0:1779690602.264293:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+74:2391:x1866137503830400:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690602.264307:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690602.264314:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 74 pid: 64445 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264325:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 74 pid: 64445 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264365:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140809 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee56f expref: 74 pid: 64445 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264381:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:0.0:1779690602.264386:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264395:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264402:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690602.264536:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690602.264605:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+73:2391:x1866137503830400:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 306us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.264614:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3336 00010000:00010000:3.0:1779690602.265712:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.265723:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266059:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266068:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266075:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266081:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690602.266096:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266104:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266117:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690602.266120:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690602.266124:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690602.266130:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a19140817 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690602.266384:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503830272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 9302us (9647us total) trans 12884902435 rc 0/0 00000100:00100000:3.0:1779690602.266394:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1184 00000040:00080000:0.0:1779690602.267957:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690602.267964:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1779690602.268567:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690602.268966:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503830656 00000100:00100000:2.0:1779690602.268975:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503830656 00000100:00100000:2.0:1779690602.269065:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:2.0:1779690602.269075:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+73:112377:x1866137503830656:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690602.269367:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+74:112377:x1866137503830656:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 293us (803us total) trans 12884902436 rc 0/0 00000100:00100000:2.0:1779690602.269375:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 166 00000040:00080000:0.0:1779690602.269465:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 10 00000040:00080000:0.0:1779690602.269475:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690602.442679:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492368768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690602.442759:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690602.442789:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492368896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690602.442855:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690602.442874:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492368768 00000100:00100000:2.0:1779690602.442882:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492368768 00000100:00100000:3.0:1779690602.442910:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492368896 00000100:00100000:3.0:1779690602.442915:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492368896 00000100:00100000:2.0:1779690602.442945:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00080000:1.0:1779690602.443019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690602.443023:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690602.443059:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492368768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690602.443091:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690602.443133:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492368768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.443245:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492369408:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443278:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690602.443298:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690602.443304:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492369024:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443329:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690602.443361:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492369408 00000100:00100000:0.0:1779690602.443377:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492369408 00000100:00100000:0.0:1779690602.443407:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1779690602.443414:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492369408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443448:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492369408:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.443454:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1779690602.443491:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492369408:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443532:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492369152:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690602.443570:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690602.443575:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492369280:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443594:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690602.443622:0:3319:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968462 gen 2 00000004:00080000:0.0:1779690602.443626:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f963e5180, transno 4294968462 00000100:00100000:0.0:1779690602.443641:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492368768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690602.443667:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492369152 00000100:00100000:0.0:1779690602.443671:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492369152 00000100:00100000:0.0:1779690602.443697:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492369280 00000100:00100000:0.0:1779690602.443710:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492369280 00000100:00100000:0.0:1779690602.443732:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1779690602.443739:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492369152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443773:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492369152:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.443779:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1779690602.443791:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1779690602.443798:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492369280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443856:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492369280:12345-0@lo:400:kworker.0 Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.443862:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1779690602.443887:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492369280:0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.443895:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492369152:0@lo:400:kworker.0 00000100:00080000:0.0:1779690602.443920:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690602.444228:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492369024 00000100:00100000:0.0:1779690602.444233:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492369024 00000100:00100000:0.0:1779690602.444260:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1779690602.444266:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492369024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690602.444303:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492369024:12345-0@lo:400:kworker.0 Request processed in 37us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690602.444309:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1779690602.444338:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492369024:0@lo:400:kworker.0 00000100:00100000:3.0:1779690602.444925:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1779690602.444938:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1866137492368896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690602.444964:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3825205248 avail 3823108096 00000100:00100000:3.0:1779690602.445007:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1866137492368896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690602.445015:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1779690602.445048:0:3320:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968356 gen 2 00000004:00080000:3.0:1779690602.445054:0:3320:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968356 committed transno 4294968356 00000100:00100000:3.0:1779690602.445086:0:3320:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e2f963e5c00 x1866137492367616/t4294968357(4294968357) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1779690613 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1779690602.445103:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492368896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690602.450927:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00010000:00010000:1.0:1779690602.953091:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690602.991103:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968358 is committed 00000001:00080000:2.0:1779690603.002513:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902432 is committed 00000001:00080000:2.0:1779690603.002528:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902422 is committed 00000001:00080000:2.0:1779690603.002534:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902434 is committed 00000001:00080000:2.0:1779690603.002549:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902436 is committed 00000020:00080000:2.0:1779690603.002570:0:57578:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8590018971 batchid updated 00000020:00080000:0.0:1779690603.002647:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018971 00000020:00080000:0.0:1779690603.002658:0:57599:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590018971 00000040:00080000:3.0:1779690603.279921:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690603.279931:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690603.279984:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 46 count 10 00000040:00080000:3.0:1779690603.279991:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690603.367615:0:73487:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690603.367623:0:73487:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690603.367709:0:73487:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 46 count 10 00000040:00080000:3.0:1779690603.367714:0:73487:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690603.407041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.407131:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503830912 00000100:00100000:0.0:1779690603.407141:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503830912 00000100:00100000:0.0:1779690603.407214:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1185 00000100:00100000:0.0:1779690603.407226:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+63:112386:x1866137503830912:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690603.407245:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.407265:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914081e lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee576 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.407358:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.407380:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.407390:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690603.407404:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00010000:00010000:0.0:1779690603.407566:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914081e lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee576 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.407581:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee576 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.407590:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:0.0:1779690603.407593:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1779690603.407596:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282000, rc 0) 00000100:00100000:0.0:1779690603.407647:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:112386:x1866137503830912:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 425us (614us total) trans 12884902437 rc 0/0 00000100:00100000:0.0:1779690603.407655:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1185 00000100:00080000:1.0:1779690603.408251:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690603.410412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.410898:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831040 00000100:00100000:0.0:1779690603.410907:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831040 00000100:00100000:0.0:1779690603.410965:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6523 00000100:00100000:0.0:1779690603.410975:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503831040:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:0.0:1779690603.411012:0:10273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411031:0:10273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411047:0:10273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 7 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411054:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690603.411056:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690603.411060:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411093:0:10273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 7 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411107:0:10273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 7 pid: 22279 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.411121:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492369536:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690603.411219:0:10273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.411228:0:10273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.411236:0:10273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492369664:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690603.411256:0:10273:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f90381780 going to sleep for 11 seconds 00000100:00080000:1.0:1779690603.414055:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690603.424405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.424484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.424512:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831168 00000100:00100000:0.0:1779690603.424522:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831168 00010000:00010000:0.0:1779690603.424573:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 8 pid: 22279 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.424602:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831296 00000100:00100000:0.0:1779690603.424606:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831296 00010000:00010000:0.0:1779690603.424619:0:5779:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 19 pid: 49882 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.424638:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3337 00000100:00100000:0.0:1779690603.424646:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503831168:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690603.424659:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690603.424679:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 8 pid: 22279 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.424702:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 8 pid: 22279 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.424728:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690603.424776:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503831168:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.424784:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3337 00000100:00100000:0.0:1779690603.424911:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3338 00000100:00100000:0.0:1779690603.424918:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503831296:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690603.424934:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690603.424944:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 19 pid: 49882 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.424953:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 19 pid: 49882 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.424966:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690603.424967:0:5779:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690603.424973:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.424982:0:5779:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.425000:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690603.425019:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503831296:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 101us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.425025:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3338 00000100:00080000:0.0:1779690603.425047:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690603.425263:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffcda23a/0xb4bb873a19140799 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee545 expref: 7 pid: 22279 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.425277:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492369536:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690603.425289:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4701ddd/0xb4bb873a19140768 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee530 expref: 18 pid: 49882 timeout: 3430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.425298:0:10273:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10273:1866137492369664:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690603.425319:0:10273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425327:0:10273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425335:0:10273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425365:0:10273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425374:0:10273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425382:0:10273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425389:0:10273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282e00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690603.425393:0:10273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425401:0:10273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425412:0:10273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.425420:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088fde728/0xb4bb873a19140833 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.425516:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+17:2392:x1866137503831040:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 14542us (15110us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690603.425534:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6523 00000100:00100000:1.0:1779690603.429916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.429953:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831552 00000100:00100000:1.0:1779690603.429961:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831552 00000100:00100000:1.0:1779690603.430003:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:1.0:1779690603.430011:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:112386:x1866137503831552:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:1.0:1779690603.430066:0:57562:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee576 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690603.430293:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902438 00000001:00080000:1.0:1779690603.431008:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902439 00010000:00010000:1.0:1779690603.431062:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431078:0:57562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431086:0:57562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431094:0:57562:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431126:0:57562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431142:0:57562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 68 pid: 57585 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.431163:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492369792:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690603.431258:0:57562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 58 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.431267:0:57562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 58 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.431276:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492369920:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690603.431299:0:57562:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690603.434411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.434441:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831808 00000100:00100000:1.0:1779690603.434448:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831808 00010000:00010000:1.0:1779690603.434493:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 59 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.434526:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3339 00000100:00100000:1.0:1779690603.434535:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503831808:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690603.434548:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690603.434555:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 59 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.434566:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 59 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.434587:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690603.434599:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.434608:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.434615:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690603.434659:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503831808:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.434668:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3339 00000100:00080000:1.0:1779690603.434698:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690603.435321:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492369792:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690603.435334:0:57562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a191406ce lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4ff expref: 58 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.435349:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:57562:1866137492369920:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690603.435370:0:57562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.435476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.435525:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503831680 00000100:00100000:0.0:1779690603.435529:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503831680 00010000:00010000:0.0:1779690603.435550:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 69 pid: 57585 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.435580:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3340 00000100:00100000:0.0:1779690603.435589:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+69:2391:x1866137503831680:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690603.435599:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690603.435605:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 69 pid: 57585 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435616:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 69 pid: 57585 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435631:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a19140761 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee529 expref: 69 pid: 57585 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435644:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:0.0:1779690603.435648:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435656:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435663:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.435697:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690603.435736:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503831680:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.435742:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3340 00010000:00010000:1.0:1779690603.436178:0:57562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.436186:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1779690603.436310:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902440 00000001:00080000:1.0:1779690603.436533:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902441 00000001:00080000:1.0:1779690603.436587:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902442 00000100:00100000:1.0:1779690603.436664:0:57562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492370048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1779690603.436769:0:57562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690603.436830:0:57562:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690603.436861:0:40691:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492370048 00000100:00100000:0.0:1779690603.436868:0:40691:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492370048 00000100:00100000:0.0:1779690603.436906:0:40691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:0.0:1779690603.436915:0:40691:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57562:x1866137492370048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1779690603.436992:0:40691:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57562:x1866137492370048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.437001:0:40691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1779690603.437017:0:57562:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968358 gen 2 00000004:00080000:1.0:1779690603.437022:0:57562:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f963e5c00, transno 4294968357 00000004:00080000:1.0:1779690603.437044:0:57562:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f963e7b80, transno 4294968358 00000100:00100000:1.0:1779690603.437050:0:57562:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:57562:1866137492370048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1779690603.437123:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902443 00010000:00010000:1.0:1779690603.437161:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437168:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437174:0:57562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437179:0:57562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690603.437183:0:57562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437190:0:57562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437201:0:57562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690603.437204:0:57562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1779690603.437208:0:57562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.437213:0:57562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a1914083a lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690603.437666:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x97:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1779690603.437945:0:57562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].14, 64 off9136 00000004:00080000:1.0:1779690603.437967:0:57562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3331012160887ns, next at 3332012158846ns, rc = 0 00000001:00080000:1.0:1779690603.437974:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902444 00010000:00010000:1.0:1779690603.438008:0:57562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f90226f00) 00010000:00010000:1.0:1779690603.438011:0:57562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1779690603.438017:0:57562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140825 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee576 expref: 72 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.438119:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e775ff0e-5641-488a-99d7-1331a4992115+71:112386:x1866137503831552:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 8107us (8210us total) trans 12884902445 rc 0/0 00000100:00100000:1.0:1779690603.438127:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000020:00080000:1.0:1779690603.438132:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1779690603.454136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.454186:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832064 00000100:00100000:3.0:1779690603.454197:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832064 00000100:00100000:3.0:1779690603.454250:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1186 00000100:00100000:3.0:1779690603.454261:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+71:112387:x1866137503832064:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690603.454284:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690603.454303:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140841 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee57d expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.454391:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.454405:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.454416:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690603.454428:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2f:0x0]: returning size 0 00010000:00010000:3.0:1779690603.454541:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a000/0xb4bb873a19140841 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee57d expref: 74 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.454556:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee57d expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.454565:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690603.454568:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690603.454571:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b000, rc 0) 00000100:00100000:3.0:1779690603.454644:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+73:112387:x1866137503832064:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 385us (516us total) trans 12884902446 rc 0/0 00000100:00100000:3.0:1779690603.454651:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1186 00000100:00100000:1.0:1779690603.462121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.462195:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832192 00000100:00100000:3.0:1779690603.462204:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832192 00000100:00100000:3.0:1779690603.462277:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6524 00000100:00100000:3.0:1779690603.462287:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503832192:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:3.0:1779690603.462325:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462340:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462346:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 12 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462351:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690603.462352:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690603.462355:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462378:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 12 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462387:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 12 pid: 15940 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.462412:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492370176:192.168.203.5@tcp:104: 00000100:00080000:1.0:1779690603.462481:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1779690603.462513:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.462521:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 10 pid: 6582 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.462528:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492370304:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690603.462546:0:6582:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138480 going to sleep for 11 seconds 00000100:00100000:1.0:1779690603.466794:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.467038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.467091:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492370176:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690603.467107:0:6582:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1866137492370304:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690603.467197:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.467235:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832320 00000100:00100000:1.0:1779690603.467242:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832320 00010000:00010000:1.0:1779690603.467273:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.467302:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832448 00000100:00100000:1.0:1779690603.467305:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832448 00010000:00010000:1.0:1779690603.467319:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 11 pid: 6582 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.467345:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3341 00000100:00100000:1.0:1779690603.467355:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503832320:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690603.467375:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690603.467397:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.467411:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.467437:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c383c017/0xb4bb873a191407fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee568 expref: 13 pid: 15940 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.467455:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690603.467502:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503832320:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 147us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.467510:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3341 00000100:00100000:1.0:1779690603.467531:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3342 00000100:00100000:1.0:1779690603.467540:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+11:2392:x1866137503832448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690603.467549:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690603.467560:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 11 pid: 6582 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.467573:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 11 pid: 6582 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.467589:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f4ce1d/0xb4bb873a191407d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee55a expref: 11 pid: 6582 timeout: 3431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.469368:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690603.469371:0:17231:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690603.469377:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.469388:0:17231:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.469421:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1779690603.469446:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469465:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.469470:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503832448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1928us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.469483:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3342 00010000:00010000:2.0:1779690603.469500:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469510:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469519:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469526:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a000 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690603.469531:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469540:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469552:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.469560:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffcda23a/0xb4bb873a19140856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690603.469627:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503832192:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 7341us (7515us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690603.469637:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6524 00000100:00100000:2.0:1779690603.472377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.473136:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832704 00000100:00100000:0.0:1779690603.473147:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832704 00000100:00100000:0.0:1779690603.473199:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:0.0:1779690603.473210:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+73:112387:x1866137503832704:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:0.0:1779690603.473272:0:57563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000bd3:0x2f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee57d expref: 73 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1779690603.473572:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902447 00000001:00080000:0.0:1779690603.473918:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902448 00010000:00010000:0.0:1779690603.473978:0:57563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.474832:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.474843:0:57563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 76 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.474865:0:57563:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 5/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.474902:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 76 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.474916:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 76 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.474931:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492370432:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690603.475411:0:57563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 57 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.475421:0:57563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 57 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.475431:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492370560:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690603.475457:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bee5f000 going to sleep for 11 seconds 00000100:00100000:1.0:1779690603.486274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.486374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.486405:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832832 00000100:00100000:1.0:1779690603.486414:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832832 00010000:00010000:1.0:1779690603.486451:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 77 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.486493:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503832960 00000100:00100000:1.0:1779690603.486497:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503832960 00000100:00100000:2.0:1779690603.486505:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3343 00010000:00010000:1.0:1779690603.486512:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 58 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690603.486520:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+77:2392:x1866137503832832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690603.486535:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1779690603.486537:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3344 00010000:00010000:2.0:1779690603.486545:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 77 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.486549:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+58:2392:x1866137503832960:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690603.486567:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 77 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.486573:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690603.486580:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 58 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.486592:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 58 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.486906:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:2.0:1779690603.486913:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.486923:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.486930:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690603.486984:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+77:2392:x1866137503832832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 467us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690603.486993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3343 00010000:00010000:1.0:1779690603.487073:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:1.0:1779690603.487078:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.487088:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.487095:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.487114:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690603.487151:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+58:2392:x1866137503832960:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 605us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.487158:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3344 00010000:00010000:3.0:1779690603.487479:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871200/0xb4bb873a191407d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee553 expref: 76 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.487500:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492370432:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690603.487514:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140714 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee514 expref: 57 pid: 57561 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.487523:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:57563:1866137492370560:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690603.487543:0:57563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.487551:0:57563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.487557:0:57563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1779690603.488416:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902449 00000001:00080000:3.0:1779690603.488779:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902450 00000001:00080000:3.0:1779690603.488936:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902451 00000100:00100000:3.0:1779690603.489033:0:57563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492370688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1779690603.489095:0:57563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690603.489127:0:57563:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138780 going to sleep for 11 seconds 00000100:00100000:0.0:1779690603.489438:0:6592:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492370688 00000100:00100000:0.0:1779690603.489445:0:6592:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492370688 00000100:00100000:0.0:1779690603.489490:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:0.0:1779690603.489500:0:6592:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492370688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1779690603.489593:0:6592:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57563:x1866137492370688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.489602:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:3.0:1779690603.489892:0:57563:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:57563:1866137492370688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1779690603.489946:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902452 00010000:00010000:3.0:1779690603.489991:0:57563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490002:0:57563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490009:0:57563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490015:0:57563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690603.490019:0:57563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490027:0:57563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490041:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690603.490044:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1779690603.490049:0:57563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.490067:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914085d lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1779690603.490471:0:57563:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd2:0x98:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1779690603.490884:0:57563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13:0x0].13, 64 off9120 00000004:00080000:3.0:1779690603.490898:0:57563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3331065091973ns, next at 3332065089026ns, rc = 0 00000001:00080000:3.0:1779690603.490905:0:57563:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902453 00010000:00010000:3.0:1779690603.490956:0:57563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90226e00) 00010000:00010000:3.0:1779690603.490960:0:57563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1779690603.490967:0:57563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140848 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee57d expref: 80 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.491083:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e775ff0e-5641-488a-99d7-1331a4992115+79:112387:x1866137503832704:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 17874us (18711us total) trans 12884902454 rc 0/0 00000100:00100000:3.0:1779690603.491093:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000020:00080000:3.0:1779690603.491098:0:57563:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1779690603.520013:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.520281:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833088 00000100:00100000:0.0:1779690603.520291:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833088 00000100:00100000:0.0:1779690603.520387:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1187 00000100:00100000:0.0:1779690603.520399:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+57:112391:x1866137503833088:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690603.520423:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.520441:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee584 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.520508:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.520524:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.520536:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690603.520752:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 7680 00000004:00200000:0.0:1779690603.520756:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690603.520952:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.520981:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee584 expref: 59 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.521005:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee584 expref: 58 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.521014:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.521026:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690603.521039:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690603.521096:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+58:112391:x1866137503833088:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 700us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.521104:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1187 00000100:00100000:0.0:1779690603.537908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690603.538002:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833216 00000100:00100000:2.0:1779690603.538020:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833216 00000100:00100000:2.0:1779690603.538077:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1188 00000100:00100000:2.0:1779690603.538087:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:112392:x1866137503833216:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1779690603.538108:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690603.538129:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140872 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee58b expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538253:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538672:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538696:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538714:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538722:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.538728:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539217:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539226:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539233:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539246:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2ca00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690603.539251:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539258:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539340:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690603.539343:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690603.539349:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539355:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ca00/0xb4bb873a19140879 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539369:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539375:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539381:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539386:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690603.539388:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539393:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539412:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x32d22ff1 (ffff9e2f90226200) 00010000:00010000:2.0:1779690603.539415:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690603.539418:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539424:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c000/0xb4bb873a19140880 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539460:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140872 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee58b expref: 59 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539471:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690603.539473:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690603.539477:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140872 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee58b expref: 59 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.539487:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d800, rc 0) 00000100:00100000:2.0:1779690603.539557:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+58:112392:x1866137503833216:12345-192.168.203.5@tcp:101:rm.0 Request processed in 1467us (1654us total) trans 0 rc 301/301 00000100:00100000:2.0:1779690603.539567:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1188 00000100:00100000:1.0:1779690603.550550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.550846:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833472 00000100:00100000:3.0:1779690603.550871:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833472 00000100:00100000:3.0:1779690603.550934:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1189 00000100:00100000:3.0:1779690603.550944:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+58:112393:x1866137503833472:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1779690603.550964:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690603.550968:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1779690603.550993:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a1914086b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee584 expref: 58 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551013:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:3.0:1779690603.551018:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1779690603.551044:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140887 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee592 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551350:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551364:0:57585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 78 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551373:0:57585:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551403:0:57585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 78 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.551415:0:57585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 78 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.551428:0:57585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492370816:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690603.551536:0:57585:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1779690603.557028:0:57585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:57585:1866137492370816:192.168.203.5@tcp:104: 00010000:00010000:3.0:1779690603.557056:0:57585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.557701:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.558008:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833600 00000100:00100000:3.0:1779690603.558015:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833600 00010000:00010000:3.0:1779690603.558059:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 79 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690603.558120:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3345 00000100:00100000:3.0:1779690603.558130:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+79:2392:x1866137503833600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690603.558153:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690603.558160:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 79 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558171:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 79 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558192:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140776 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee537 expref: 79 pid: 64445 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558209:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:3.0:1779690603.558214:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558224:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558231:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.558304:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690603.558361:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e775ff0e-5641-488a-99d7-1331a4992115+78:2392:x1866137503833600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 232us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690603.558368:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3345 00010000:00010000:0.0:1779690603.558997:0:57585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.559005:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.559129:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.559199:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.559210:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690603.560304:0:57585:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f5:0x0], index 0: 0 00010000:00010000:0.0:1779690603.560495:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914089c lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560505:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914089c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560512:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914089c lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560546:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560563:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560580:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560584:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4a200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690603.560586:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560591:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560599:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.560717:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690603.560725:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560732:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4a200/0xb4bb873a1914088e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690603.560745:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000082ae83f2 reply state 00000000d7673a7a transno 12884902455 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690603.560754:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690603.560788:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140887 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee592 expref: 60 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560925:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282e00/0xb4bb873a1914089c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee592 expref: 59 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.560945:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690603.560948:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690603.560951:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282e00, rc 0) 00000100:00100000:0.0:1779690603.561009:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+60:112393:x1866137503833472:12345-192.168.203.5@tcp:101:dd.0 Request processed in 10068us (10469us total) trans 12884902455 rc 0/0 00000100:00100000:0.0:1779690603.561015:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1189 00010000:00010000:2.0:1779690603.562917:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562931:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562938:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562960:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690603.562964:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562972:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562986:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x32d22ff1 (ffff9e30bf50f200) 00010000:00010000:2.0:1779690603.562989:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690603.562993:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.562999:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140895 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.564090:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.564391:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833856 00000100:00100000:0.0:1779690603.564401:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833856 00000100:00100000:0.0:1779690603.564451:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:0.0:1779690603.564461:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b42e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+59:112393:x1866137503833856:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:0.0:1779690603.564961:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b42e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+60:112393:x1866137503833856:12345-192.168.203.5@tcp:35:dd.0 Request processed in 499us (874us total) trans 12884902456 rc 0/0 00000100:00100000:0.0:1779690603.564975:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:1.0:1779690603.599316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.599484:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503833984 00000100:00100000:0.0:1779690603.599495:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503833984 00000100:00100000:0.0:1779690603.599553:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1190 00000100:00100000:0.0:1779690603.599562:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+60:112399:x1866137503833984:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690603.599585:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.599615:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee599 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.599681:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.599704:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.599726:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690603.599783:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 7680 00000004:00200000:0.0:1779690603.599786:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690603.600189:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.600215:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee599 expref: 62 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.600232:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee599 expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.600240:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.600242:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690603.600245:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:0.0:1779690603.600405:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+61:112399:x1866137503833984:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 843us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690603.600413:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1190 00000100:00100000:2.0:1779690603.609580:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.610030:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503834112 00000100:00100000:0.0:1779690603.610039:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503834112 00000100:00100000:0.0:1779690603.610130:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1191 00000100:00100000:0.0:1779690603.610150:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+61:112400:x1866137503834112:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1779690603.610170:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.610190:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5a0 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610282:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610296:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610307:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610320:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610326:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610332:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610390:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610397:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610403:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610408:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690603.610412:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610429:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610440:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.610443:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690603.610447:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610453:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408bf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610467:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610472:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610478:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610483:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690603.610486:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610491:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610497:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xc9aa4189 (ffff9e30bf50fa00) 00010000:00010000:0.0:1779690603.610499:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690603.610501:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610511:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610541:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408b8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5a0 expref: 62 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610550:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.610552:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690603.610556:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5a0 expref: 62 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.610564:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282000, rc 0) 00000100:00100000:0.0:1779690603.610666:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+61:112400:x1866137503834112:12345-192.168.203.5@tcp:101:rm.0 Request processed in 526us (1093us total) trans 0 rc 301/301 00000100:00100000:0.0:1779690603.610673:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1191 00000100:00100000:1.0:1779690603.619287:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.619521:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503834368 00000100:00100000:0.0:1779690603.619532:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503834368 00000100:00100000:0.0:1779690603.619593:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1192 00000100:00100000:0.0:1779690603.619604:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+61:112401:x1866137503834368:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1779690603.619624:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.619628:0:57585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1779690603.619652:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191408b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee599 expref: 61 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.619670:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690603.619675:0:57585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690603.619710:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408cd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5a7 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.619890:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.619904:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.619916:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.620055:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.620064:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.620071:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1779690603.621000:0:57585:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f5:0x0], index 1: 0 00010000:00010000:1.0:1779690603.621201:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191408e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621220:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191408e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621229:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191408e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621264:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621271:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621278:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621284:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b282800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690603.621288:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621294:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621304:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690603.621308:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690603.621312:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621318:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191408d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1779690603.621330:0:57585:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004087b884 reply state 0000000059c1751f transno 12884902457 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.621344:0:57585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1779690603.621376:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a191408cd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5a7 expref: 63 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621389:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871e00/0xb4bb873a191408e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5a7 expref: 62 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.621397:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:1.0:1779690603.621399:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690603.621401:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871e00, rc 0) 00000100:00100000:1.0:1779690603.621473:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:112401:x1866137503834368:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1871us (2194us total) trans 12884902457 rc 0/0 00000100:00100000:1.0:1779690603.621481:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1192 00010000:00010000:0.0:1779690603.624562:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624577:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624583:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624589:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690603.624592:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624624:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624639:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xc9aa4189 (ffff9e30bf50fa00) 00010000:00010000:0.0:1779690603.624641:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690603.624646:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690603.624651:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408db lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690603.625665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.625883:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503834624 00000100:00100000:3.0:1779690603.625900:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503834624 00000100:00100000:3.0:1779690603.627288:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:3.0:1779690603.627306:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+62:112401:x1866137503834624:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:3.0:1779690603.627653:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+63:112401:x1866137503834624:12345-192.168.203.5@tcp:35:dd.0 Request processed in 354us (1992us total) trans 12884902458 rc 0/0 00000100:00100000:3.0:1779690603.627660:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:1.0:1779690603.657414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690603.658446:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503834752 00000100:00100000:0.0:1779690603.658458:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503834752 00000100:00100000:0.0:1779690603.658525:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1193 00000100:00100000:0.0:1779690603.658535:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+78:112404:x1866137503834752:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1779690603.658559:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690603.658579:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5ae expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658719:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658735:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658747:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658763:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658770:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658790:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658900:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658909:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658916:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690603.658945:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x30:0x0]: returning size 0 00000004:00200000:1.0:1779690603.658949:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690603.658971:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658982:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658989:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.658996:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659003:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659009:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690603.659013:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659025:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659034:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690603.659036:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690603.659040:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659044:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870600/0xb4bb873a191408f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659056:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659060:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659063:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659066:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690603.659068:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659071:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659074:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x32d22ff1 (ffff9e2f90442c00) 00010000:00010000:1.0:1779690603.659076:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690603.659077:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659084:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a191408fe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659109:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a191408f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ae expref: 80 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659117:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870c00/0xb4bb873a19140905 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ae expref: 79 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690603.659122:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:1.0:1779690603.659124:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690603.659125:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870c00, rc 0) 00000100:00100000:1.0:1779690603.659242:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+79:112404:x1866137503834752:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 708us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.659250:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1193 00000100:00100000:2.0:1779690603.664026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690603.664305:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503834880 00000100:00100000:3.0:1779690603.664316:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503834880 00000100:00100000:3.0:1779690603.664364:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6525 00000100:00100000:3.0:1779690603.664375:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+17:2389:x1866137503834880:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690603.664394:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690603.664413:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084c1ebfd/0xb4bb873a1914090c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5b5 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690603.664441:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1779690603.664456:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690603.664458:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690603.664465:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084c1ebfd/0xb4bb873a1914090c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5b5 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.664484:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084c1ebfd/0xb4bb873a1914090c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5b5 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690603.664496:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4a800, rc 0) 00000100:00100000:3.0:1779690603.664553:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+18:2389:x1866137503834880:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 180us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690603.664576:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6525 00000100:00100000:0.0:1779690603.667110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690603.667303:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835008 00000100:00100000:2.0:1779690603.667311:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835008 00000100:00100000:2.0:1779690603.667363:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1194 00000100:00100000:2.0:1779690603.667370:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+79:112404:x1866137503835008:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690603.667385:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690603.667400:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5bc expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667449:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667460:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667478:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690603.667524:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x96:0x0]: returning size 7680 00000004:00200000:2.0:1779690603.667527:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690603.667542:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667560:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d200/0xb4bb873a19140913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 81 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667759:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 80 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690603.667768:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690603.667771:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690603.667775:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2cc00, rc 0) 00000100:00100000:2.0:1779690603.667916:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+80:112404:x1866137503835008:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 546us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690603.667921:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1194 00000100:00100000:2.0:1779690603.673961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690603.674017:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835264 00000100:00100000:1.0:1779690603.674027:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835264 00000100:00100000:1.0:1779690603.674083:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1195 00000100:00100000:1.0:1779690603.674094:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+80:112404:x1866137503835264:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:1.0:1779690603.674511:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].46, 136 off14448 00000100:00100000:1.0:1779690603.674603:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+80:112404:x1866137503835264:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 503us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690603.674613:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1195 00010000:00010000:1.0:1779690603.978196:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690604.238050:0:73538:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690604.238058:0:73538:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690604.238133:0:73538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 47 count 11 00000040:00080000:3.0:1779690604.238139:0:73538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690604.297990:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690604.297999:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690604.298042:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 47 count 11 00000040:00080000:3.0:1779690604.298049:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690604.298288:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492370944:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690604.298391:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e309d8c0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1779690604.308180:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492370944:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690604.309099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.309155:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835392 00000100:00100000:1.0:1779690604.309161:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835392 00000100:00100000:1.0:1779690604.309214:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1196 00000100:00100000:1.0:1779690604.309223:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112415:x1866137503835392:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690604.309253:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690604.309346:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112415:x1866137503835392:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.309353:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1196 00000100:00100000:3.0:1779690604.313677:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.314329:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835648 00000100:00100000:1.0:1779690604.314339:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835648 00000100:00100000:1.0:1779690604.314403:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1197 00000100:00100000:1.0:1779690604.314415:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:112415:x1866137503835648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690604.314436:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690604.314454:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140921 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5c3 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.314546:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140928 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.314561:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.314574:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690604.314585:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x30:0x0]: returning size 0 00010000:00010000:1.0:1779690604.314722:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871a00/0xb4bb873a19140921 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5c3 expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.314742:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5c3 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.314757:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:1.0:1779690604.314761:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690604.314764:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870e00, rc 0) 00000100:00100000:1.0:1779690604.314842:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503835648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 430us (1175us total) trans 12884902459 rc 0/0 00000100:00100000:1.0:1779690604.314850:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1197 00000100:00100000:0.0:1779690604.320790:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.320913:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835776 00000100:00100000:1.0:1779690604.320925:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835776 00000100:00100000:1.0:1779690604.320985:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6526 00000100:00100000:1.0:1779690604.320997:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503835776:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690604.321045:0:22279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321073:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690604.321075:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690604.321081:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321095:0:22279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321126:0:22279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321135:0:22279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321151:0:22279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321158:0:22279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871a00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690604.321163:0:22279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321172:0:22279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321194:0:22279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.321202:0:22279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a19140936 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690604.321213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.321244:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503835904 00000100:00100000:0.0:1779690604.321250:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503835904 00000100:00100000:1.0:1779690604.321280:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+7:2391:x1866137503835776:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 285us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.321288:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6526 00000100:00100000:0.0:1779690604.321481:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18690 00000100:00100000:0.0:1779690604.321491:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+65:2390:x1866137503835904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690604.321510:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690604.321528:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140928 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5c3 expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.321544:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690604.321559:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690604.321582:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+64:2390:x1866137503835904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.321588:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18690 00000100:00100000:3.0:1779690604.323019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.323042:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836160 00000100:00100000:1.0:1779690604.323050:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836160 00000100:00100000:1.0:1779690604.323107:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1198 00000100:00100000:1.0:1779690604.323116:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:112415:x1866137503836160:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690604.323195:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:112415:x1866137503836160:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.323210:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1198 00000100:00100000:0.0:1779690604.328041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.328997:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836288 00000100:00100000:1.0:1779690604.329006:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836288 00000100:00100000:1.0:1779690604.329051:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6527 00000100:00100000:1.0:1779690604.329061:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+7:2389:x1866137503836288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690604.329082:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690604.329099:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a1914093d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5ca expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.329122:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690604.329124:0:22747:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690604.329131:0:22747:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a1914093d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ca expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.329147:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026653b30/0xb4bb873a1914093d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ca expref: 8 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.329161:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871a00, rc 0) 00000100:00100000:1.0:1779690604.329222:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2389:x1866137503836288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 162us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.329232:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6527 00000100:00100000:0.0:1779690604.332024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.332097:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836544 00000100:00100000:1.0:1779690604.332105:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836544 00000100:00100000:1.0:1779690604.332221:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1199 00000100:00100000:1.0:1779690604.332232:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:112415:x1866137503836544:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690604.332381:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:112415:x1866137503836544:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.332389:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1199 00000100:00100000:3.0:1779690604.344214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.344722:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836672 00000100:00100000:0.0:1779690604.344732:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836672 00000100:00100000:0.0:1779690604.344782:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1200 00000100:00100000:0.0:1779690604.344792:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+64:112415:x1866137503836672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690604.344833:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690604.344854:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140944 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5d1 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.344889:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.344903:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.344915:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.345016:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140944 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.345031:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.345040:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690604.345043:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690604.345046:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:0.0:1779690604.345109:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503836672:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 318us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.345116:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1200 00000100:00100000:3.0:1779690604.353127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690604.353393:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836800 00000100:00100000:3.0:1779690604.353402:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836800 00000100:00100000:3.0:1779690604.353456:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1201 00000100:00100000:3.0:1779690604.353468:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503836800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690604.353496:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690604.353606:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503836800:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 130us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690604.353614:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1201 00000100:00100000:2.0:1779690604.359390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690604.359420:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503836928 00000100:00100000:2.0:1779690604.359428:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503836928 00000100:00100000:2.0:1779690604.359479:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6528 00000100:00100000:2.0:1779690604.359488:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503836928:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690604.359527:0:10273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359547:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690604.359549:0:10273:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690604.359555:0:10273:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359568:0:10273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359597:0:10273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359605:0:10273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359613:0:10273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359619:0:10273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2dc00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690604.359623:0:10273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359632:0:10273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359644:0:10273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690604.359656:0:10273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ee50ff8/0xb4bb873a19140952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690604.359730:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503836928:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 242us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690604.359737:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6528 00000100:00100000:2.0:1779690604.362875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.363360:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837184 00000100:00100000:1.0:1779690604.363369:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837184 00000100:00100000:1.0:1779690604.363419:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1202 00000100:00100000:1.0:1779690604.363429:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503837184:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690604.363539:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.363557:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.363567:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.363599:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.363612:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 65 pid: 57560 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690604.363626:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492371072:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690604.363912:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690604.367760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.367874:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837312 00000100:00100000:0.0:1779690604.367884:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837312 00010000:00010000:0.0:1779690604.367923:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 66 pid: 57560 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690604.367988:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3346 00000100:00100000:0.0:1779690604.367998:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+66:2391:x1866137503837312:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690604.368013:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690604.368020:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 5/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 66 pid: 57560 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.368032:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 66 pid: 57560 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.368069:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690604.368073:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.368083:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.368091:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690604.368108:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690604.368169:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7a1272b-3551-4679-9948-3e2276470519+66:2391:x1866137503837312:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 172us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.368176:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3346 00010000:00010000:1.0:1779690604.369041:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a1914094b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d1 expref: 65 pid: 57560 timeout: 3431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690604.369067:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492371072:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690604.369086:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369095:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369101:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369346:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369354:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369361:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369367:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690604.369370:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369377:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369390:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:1.0:1779690604.369393:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690604.369397:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690604.369409:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140959 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690604.369591:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503837184:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 6162us (6721us total) trans 12884902460 rc 0/0 00000100:00100000:1.0:1779690604.369603:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1202 00000040:00080000:1.0:1779690604.370173:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690604.370178:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690604.370700:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 11 00000040:00080000:1.0:1779690604.370710:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690604.375482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.375560:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837568 00000100:00100000:0.0:1779690604.375569:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837568 00000100:00100000:0.0:1779690604.375622:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:0.0:1779690604.375633:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+65:112415:x1866137503837568:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690604.375987:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+66:112415:x1866137503837568:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 355us (513us total) trans 12884902461 rc 0/0 00000100:00100000:0.0:1779690604.375995:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:2.0:1779690604.992644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690604.992780:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837696 00000100:00100000:1.0:1779690604.992790:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837696 00000100:00100000:1.0:1779690604.992899:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:1.0:1779690604.992910:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503837696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690604.994126:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503837696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1212us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690604.994139:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:2.0:1779690604.994148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.994729:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837952 00000100:00100000:0.0:1779690604.994737:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837952 00000100:00100000:0.0:1779690604.994788:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2998 00000100:00100000:0.0:1779690604.994798:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503837952:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690604.994882:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503837952:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 86us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.994903:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2998 00000100:00100000:2.0:1779690604.995331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690604.995397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690604.995432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690604.995555:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838464 00000100:00100000:3.0:1779690604.995566:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838464 00000100:00100000:3.0:1779690604.995600:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2999 00000100:00100000:3.0:1779690604.995606:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503838464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690604.995735:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+9:2392:x1866137503838464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 128us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690604.995741:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2999 00000100:00100000:0.0:1779690604.998244:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838208 00000100:00100000:0.0:1779690604.998256:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838208 00000100:00100000:0.0:1779690604.998319:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503837824 00000100:00100000:0.0:1779690604.998323:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503837824 00000100:00100000:0.0:1779690604.998349:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 311 00000100:00100000:0.0:1779690604.998357:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+80:2392:x1866137503838208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690604.998427:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+80:2392:x1866137503838208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.998434:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 311 00000100:00100000:0.0:1779690604.998462:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 312 00000100:00100000:0.0:1779690604.998471:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:2392:x1866137503837824:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690604.998500:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:2392:x1866137503837824:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.998506:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 312 00000100:00100000:2.0:1779690604.998643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690604.999159:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838080 00000100:00100000:0.0:1779690604.999164:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838080 00000100:00100000:0.0:1779690604.999299:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3000 00000100:00100000:0.0:1779690604.999325:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503838080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690604.999411:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503838080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 104us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690604.999418:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3000 00000100:00080000:1.0:1779690604.999519:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690604.999591:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690605.000364:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838336 00000100:00100000:1.0:1779690605.000372:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838336 00000100:00080000:0.0:1779690605.000404:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690605.000442:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3001 00000100:00100000:1.0:1779690605.000460:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503838336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690605.000515:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+18:2392:x1866137503838336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 65us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690605.000522:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3001 00010000:00010000:2.0:1779690605.001022:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690605.385023:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690605.385037:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690605.385087:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 47 count 11 00000040:00080000:1.0:1779690605.385093:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690605.785777:0:73589:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690605.785794:0:73589:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690605.785971:0:73589:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 47 count 11 00000040:00080000:2.0:1779690605.785979:0:73589:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690605.820369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690605.820434:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838592 00000100:00100000:1.0:1779690605.820444:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838592 00000100:00100000:1.0:1779690605.820524:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1203 00000100:00100000:1.0:1779690605.820545:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+80:112423:x1866137503838592:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690605.820565:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690605.820584:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140960 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5d8 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820644:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820658:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820681:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1779690605.820697:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690605.820698:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820707:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820714:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820834:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820860:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820867:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690605.820901:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x31:0x0]: returning size 0 00000004:00200000:1.0:1779690605.820905:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690605.820922:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820932:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820940:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820946:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820953:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820958:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690605.820962:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820969:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.820979:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690605.820988:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690605.820994:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821000:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140967 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821012:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821018:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821023:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821028:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690605.821030:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821035:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821043:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xc9aa4189 (ffff9e2f90442c00) 00010000:00010000:1.0:1779690605.821045:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690605.821048:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821053:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a1914096e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821083:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140960 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d8 expref: 82 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821107:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870a00/0xb4bb873a19140975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5d8 expref: 81 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690605.821114:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:1.0:1779690605.821116:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690605.821119:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870a00, rc 0) 00000100:00100000:1.0:1779690605.821183:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+81:112423:x1866137503838592:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 642us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690605.821190:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1203 00000100:00100000:1.0:1779690605.827241:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690605.827515:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838720 00000100:00100000:2.0:1779690605.827526:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838720 00000100:00080000:0.0:1779690605.827590:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690605.828314:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6529 00000100:00100000:2.0:1779690605.828327:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+9:2391:x1866137503838720:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690605.828351:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690605.828374:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d9c9bde/0xb4bb873a1914097c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5df expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1779690605.828403:0:6581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1779690605.828422:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690605.828424:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690605.828433:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d9c9bde/0xb4bb873a1914097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5df expref: 10 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690605.828453:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d9c9bde/0xb4bb873a1914097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5df expref: 10 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690605.828465:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d200, rc 0) 00000100:00100000:2.0:1779690605.828533:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503838720:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 210us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690605.828756:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6529 00000100:00100000:2.0:1779690605.832794:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690605.832954:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503838976 00000100:00100000:3.0:1779690605.832964:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503838976 00000100:00100000:3.0:1779690605.833016:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1204 00000100:00100000:3.0:1779690605.833027:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+81:112423:x1866137503838976:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690605.833342:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].47, 136 off14584 00000100:00100000:3.0:1779690605.833423:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+81:112423:x1866137503838976:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 398us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690605.833431:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1204 00010000:00010000:1.0:1779690606.026866:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690606.322106:0:73641:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690606.322113:0:73641:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690606.322185:0:73641:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 48 count 12 00000040:00080000:3.0:1779690606.322191:0:73641:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690606.409053:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690606.409067:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690606.409116:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 48 count 12 00000040:00080000:0.0:1779690606.409123:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690606.409365:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492371200:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690606.409461:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f934fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1779690606.420913:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690606.420956:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492371200:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1779690606.421530:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503839104 00000100:00100000:3.0:1779690606.421538:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503839104 00000100:00100000:3.0:1779690606.421636:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1205 00000100:00100000:3.0:1779690606.421645:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+66:112434:x1866137503839104:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690606.421683:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x31:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1779690606.421947:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690606.422388:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+66:112434:x1866137503839104:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 740us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.422398:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1205 00000100:00100000:2.0:1779690606.428206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690606.428338:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503839360 00000100:00100000:0.0:1779690606.428348:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503839360 00000100:00100000:0.0:1779690606.428436:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1206 00000100:00100000:0.0:1779690606.428447:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:112434:x1866137503839360:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690606.428467:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690606.428486:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140983 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5e6 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.428589:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1914098a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.428605:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1914098a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.428618:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1914098a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690606.428630:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x31:0x0]: returning size 0 00010000:00010000:0.0:1779690606.428765:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140983 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5e6 expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.428781:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1914098a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5e6 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.428801:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:0.0:1779690606.429098:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690606.429102:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282000, rc 0) 00000100:00100000:0.0:1779690606.429254:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503839360:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 808us (1055us total) trans 12884902462 rc 0/0 00000100:00100000:0.0:1779690606.429275:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1206 00000100:00100000:3.0:1779690606.435046:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.435076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.435099:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503839616 00000100:00100000:3.0:1779690606.435108:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503839616 00000100:00100000:3.0:1779690606.435162:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6530 00000100:00100000:3.0:1779690606.435171:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503839616:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1779690606.435213:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435228:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690606.435230:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690606.435235:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435250:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435276:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435285:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435293:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435300:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4aa00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:3.0:1779690606.435309:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435319:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435333:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435341:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ccf317/0xb4bb873a19140998 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690606.435411:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+12:2391:x1866137503839616:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 241us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.435419:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6530 00000100:00100000:3.0:1779690606.435442:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503839488 00000100:00100000:3.0:1779690606.435446:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503839488 00000100:00100000:3.0:1779690606.435474:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18691 00000100:00100000:3.0:1779690606.435480:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+68:2389:x1866137503839488:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690606.435488:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690606.435502:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a1914098a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5e6 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.435514:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:3.0:1779690606.435519:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690606.435536:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+67:2389:x1866137503839488:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.435551:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18691 00000100:00080000:3.0:1779690606.435572:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690606.437176:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.437236:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503839872 00000100:00100000:3.0:1779690606.437242:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503839872 00000100:00100000:3.0:1779690606.437285:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1207 00000100:00100000:3.0:1779690606.437295:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+67:112434:x1866137503839872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690606.437373:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+67:112434:x1866137503839872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.437380:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1207 00000100:00100000:3.0:1779690606.440272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690606.440410:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840000 00000100:00100000:1.0:1779690606.440418:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840000 00000100:00100000:1.0:1779690606.440496:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6531 00000100:00100000:1.0:1779690606.440507:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+12:2392:x1866137503840000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690606.440523:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690606.440538:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c30b918/0xb4bb873a1914099f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5ed expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690606.440560:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690606.440562:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690606.440568:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c30b918/0xb4bb873a1914099f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ed expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690606.440583:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c30b918/0xb4bb873a1914099f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5ed expref: 13 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690606.440625:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871200, rc 0) 00000100:00100000:1.0:1779690606.440689:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503840000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 185us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690606.440697:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6531 00000100:00100000:0.0:1779690606.442377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.442454:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840256 00000100:00100000:3.0:1779690606.442460:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840256 00000100:00100000:3.0:1779690606.442530:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1208 00000100:00100000:3.0:1779690606.442539:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:112434:x1866137503840256:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1779690606.442622:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:112434:x1866137503840256:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.442629:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1208 00000100:00100000:3.0:1779690606.445044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690606.445130:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840384 00000100:00100000:0.0:1779690606.445137:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840384 00000100:00100000:0.0:1779690606.445213:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1209 00000100:00100000:0.0:1779690606.445222:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+67:112434:x1866137503840384:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690606.445247:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690606.445271:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191409a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5f4 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445305:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445325:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445335:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445420:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a191409a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 69 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445447:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.445455:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:0.0:1779690606.445458:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690606.445461:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282800, rc 0) 00000100:00100000:0.0:1779690606.445516:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503840384:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 294us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690606.445522:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1209 00000100:00100000:0.0:1779690606.449674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.449737:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840512 00000100:00100000:3.0:1779690606.449747:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840512 00000100:00100000:3.0:1779690606.449845:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1210 00000100:00100000:3.0:1779690606.449855:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503840512:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690606.449882:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690606.449977:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503840512:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690606.449996:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1210 00000100:00100000:1.0:1779690606.452893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690606.452966:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840640 00000100:00100000:0.0:1779690606.452974:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840640 00000100:00100000:0.0:1779690606.453023:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6532 00000100:00100000:0.0:1779690606.453032:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503840640:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1779690606.453071:0:49882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453086:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690606.453089:0:49882:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690606.453094:0:49882:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453111:0:49882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453138:0:49882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453156:0:49882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453176:0:49882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453184:0:49882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:0.0:1779690606.453188:0:49882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453196:0:49882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453209:0:49882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.453216:0:49882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f25a56/0xb4bb873a191409b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 49882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690606.453287:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503840640:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 256us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690606.453294:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6532 00000100:00100000:0.0:1779690606.456530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690606.456602:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503840896 00000100:00100000:3.0:1779690606.456609:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503840896 00000100:00100000:3.0:1779690606.456657:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1211 00000100:00100000:3.0:1779690606.456675:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503840896:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1779690606.456741:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.456757:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.456775:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.456838:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.456852:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 68 pid: 57561 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690606.456866:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492371328:192.168.203.5@tcp:104: 00000100:00100000:3.0:1779690606.456944:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1779690606.459602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690606.459617:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492371328:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690606.459645:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690606.459688:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841024 00000100:00100000:0.0:1779690606.459695:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841024 00010000:00010000:0.0:1779690606.459739:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 69 pid: 57561 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690606.459775:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3347 00000100:00100000:0.0:1779690606.459785:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+69:2392:x1866137503841024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1779690606.459798:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690606.459848:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 69 pid: 57561 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.459862:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 69 pid: 57561 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.459883:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a191409ad lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5f4 expref: 69 pid: 57561 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.459896:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:0.0:1779690606.459911:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.459919:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690606.459926:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690606.460154:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690606.460202:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+68:2392:x1866137503841024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 417us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690606.460210:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3347 00010000:00010000:3.0:1779690606.460272:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460280:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460748:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460757:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460764:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460771:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4bc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690606.460775:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460782:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460793:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x31:0x0].0x0 (ffff9e2f90442100) 00010000:00010000:3.0:1779690606.460795:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1779690606.460799:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690606.460974:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409bb lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690606.461255:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690606.461260:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1779690606.461436:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503840896:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 4760us (4912us total) trans 12884902463 rc 0/0 00000100:00100000:3.0:1779690606.461446:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1211 00000040:00080000:2.0:1779690606.461782:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 12 00000040:00080000:2.0:1779690606.461794:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690606.464541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690606.464634:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841280 00000100:00100000:0.0:1779690606.464643:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841280 00000100:00100000:0.0:1779690606.464700:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:0.0:1779690606.464709:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+68:112434:x1866137503841280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690606.465134:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+69:112434:x1866137503841280:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 425us (600us total) trans 12884902464 rc 0/0 00000100:00100000:0.0:1779690606.465141:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 172 00010000:00010000:1.0:1779690607.049485:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690607.498275:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690607.498284:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690607.498324:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 48 count 12 00000040:00080000:0.0:1779690607.498331:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000004:00080000:3.0:1779690607.561007:0:57584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3335135199717ns, next at 3336135197823ns, rc = 0 00000100:00100000:0.0:1779690607.561392:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492371456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690607.561463:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690607.561597:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492371456 00000100:00100000:3.0:1779690607.561617:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492371456 00000100:00100000:3.0:1779690607.561694:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1779690607.561703:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492371456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690607.561735:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690607.561782:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492371456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690607.561789:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1779690607.561854:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492371456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690607.561941:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492371584:0@lo:400:kworker.0 00000100:00100000:3.0:1779690607.561970:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690607.561997:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492372096:0@lo:400:kworker.0 00000100:00100000:3.0:1779690607.562025:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690607.562045:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690607.562050:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492371712:0@lo:400:kworker.0 00000100:00100000:3.0:1779690607.562073:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690607.562099:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492371584 00000100:00100000:3.0:1779690607.562102:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492371584 00000100:00100000:1.0:1779690607.562322:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492371840:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.562355:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690607.562376:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690607.562382:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492371968:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.562406:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690607.562447:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492371968 00000100:00100000:3.0:1779690607.562452:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1779690607.562452:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492371968 00000100:00100000:3.0:1779690607.562463:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492371584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.562495:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:1.0:1779690607.562508:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492371968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690607.562509:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492371584:12345-0@lo:400:kworker.0 Request processed in 44us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690607.562521:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1779690607.562554:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492372096 00000100:00100000:3.0:1779690607.562558:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492372096 00000100:00100000:1.0:1779690607.562561:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492371968:12345-0@lo:400:kworker.0 Request processed in 57us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690607.562577:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1779690607.562584:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492371712 00000100:00100000:3.0:1779690607.562587:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492371712 00000100:00100000:1.0:1779690607.562604:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492371840 00000100:00100000:1.0:1779690607.562609:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492371840 00000100:00100000:3.0:1779690607.562624:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1779690607.562634:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.562640:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1779690607.562667:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690607.562686:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492372096:12345-0@lo:400:kworker.0 Request processed in 54us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690607.562693:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1779690607.562711:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1779690607.562711:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492371712:12345-0@lo:400:kworker.0 Request processed in 61us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690607.562721:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492371840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.562734:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1779690607.562751:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492371840:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00080000:0.0:1779690607.562797:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690607.562801:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690607.562818:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690607.562848:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492371968:0@lo:400:kworker.0 00000100:00100000:0.0:1779690607.562857:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492371840:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.563507:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492371712:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.563519:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492371584:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.563529:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492372096:0@lo:400:kworker.0 00000100:00100000:1.0:1779690607.563546:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690607.563553:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492372224:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1779690607.563564:0:57587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3335137756827ns, next at 3336137753929ns, rc = 0 00000100:00100000:1.0:1779690607.563584:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690607.563616:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492372224 00000100:00100000:1.0:1779690607.563620:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492372224 00000100:00100000:1.0:1779690607.563646:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1779690607.563709:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1779690607.565380:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492372224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690607.565416:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690607.565547:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492372224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690607.565554:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1779690607.565619:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492372224:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1779690607.929716:0:73693:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690607.929725:0:73693:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690607.930183:0:73693:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 48 count 12 00000040:00080000:2.0:1779690607.930192:0:73693:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690608.068992:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690608.069119:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841408 00000100:00100000:2.0:1779690608.069129:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841408 00000100:00100000:2.0:1779690608.069237:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1212 00000100:00100000:2.0:1779690608.069247:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+81:112452:x1866137503841408:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690608.069266:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690608.069286:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191409c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee5fb expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069345:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069359:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069371:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069383:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069390:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069396:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069505:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069514:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069521:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690608.069563:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2c:0x0]: returning size 0 00000004:00200000:2.0:1779690608.069567:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690608.069585:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069594:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069602:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069608:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069614:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069620:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690608.069624:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069631:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069659:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:2.0:1779690608.069662:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690608.069667:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069673:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a191409c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069686:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069692:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069698:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069703:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2d400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690608.069706:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069712:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069718:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xd86b4ffe (ffff9e2f90226200) 00010000:00010000:2.0:1779690608.069721:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690608.069723:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069728:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a191409d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069768:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a191409c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5fb expref: 83 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069782:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2dc00/0xb4bb873a191409d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5fb expref: 82 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.069789:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:2.0:1779690608.069791:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690608.069794:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2dc00, rc 0) 00000100:00100000:2.0:1779690608.069885:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+82:112452:x1866137503841408:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 639us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690608.069891:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1212 00000100:00080000:0.0:1779690608.070157:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690608.072755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690608.072862:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841536 00000100:00100000:1.0:1779690608.072882:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841536 00000100:00080000:0.0:1779690608.072926:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690608.072944:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6533 00000100:00100000:1.0:1779690608.072955:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+18:2391:x1866137503841536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690608.072971:0:40949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690608.072995:0:40949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b4fa77/0xb4bb873a191409de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee602 expref: -99 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690608.073020:0:40949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690608.073036:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690608.073038:0:40949:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690608.073047:0:40949:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b4fa77/0xb4bb873a191409de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee602 expref: 19 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.073064:0:40949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081b4fa77/0xb4bb873a191409de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee602 expref: 19 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.073077:0:40949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870600, rc 0) 00000100:00100000:1.0:1779690608.073129:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503841536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 176us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690608.073136:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6533 00010000:00010000:2.0:1779690608.073288:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690608.081410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690608.082041:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841792 00000100:00100000:3.0:1779690608.082050:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841792 00000100:00100000:3.0:1779690608.082098:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1213 00000100:00100000:3.0:1779690608.082109:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+82:112452:x1866137503841792:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690608.082412:0:57559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].48, 136 off14720 00000100:00100000:3.0:1779690608.082510:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+82:112452:x1866137503841792:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 403us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690608.082518:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1213 00000001:00080000:2.0:1779690608.104486:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902464 is committed 00000001:00080000:2.0:1779690608.104517:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902449 is committed 00000004:00080000:2.0:1779690608.104616:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000004:00080000:2.0:1779690608.104790:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000100:00100000:3.0:1779690608.104837:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492372352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1779690608.104904:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690608.104930:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492372352 00000100:00100000:3.0:1779690608.104957:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690608.104964:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492372480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1779690608.104986:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690608.105056:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492372352 00000100:00100000:2.0:1779690608.105076:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492372480 00000100:00100000:2.0:1779690608.105082:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492372480 00000100:00100000:1.0:1779690608.105166:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6534 00000100:00100000:1.0:1779690608.105177:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492372352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1779690608.105202:0:15940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:500 count 1 00002000:00010000:1.0:1779690608.105233:0:15940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690608.105252:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.105268:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690608.105270:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690608.105276:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.105289:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.105300:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.105308:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.105325:0:15940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1779690608.105333:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6535 00000100:00100000:2.0:1779690608.105343:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492372480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1779690608.105358:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:500 count 1 00002000:00010000:2.0:1779690608.105382:0:6583:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1779690608.105389:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.105412:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690608.105414:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690608.105417:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.105429:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.105437:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.105445:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.105468:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1779690608.105829:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492372352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 655us (925us total) trans 4294968359 rc 0/0 00000100:00100000:1.0:1779690608.105836:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6534 00000004:00080000:3.0:1779690608.105926:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e30b43f9880/2, rc 0, transno 4294968359 00000100:00100000:3.0:1779690608.105940:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492372352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1779690608.106174:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492372480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 833us (1185us total) trans 4294968463 rc 0/0 00000100:00100000:2.0:1779690608.106181:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6535 00010000:00010000:2.0:1779690608.106199:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1779690608.106205:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106215:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690608.106219:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106239:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106255:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106262:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a26770a9/0xb4bb873a191409e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106288:0:5783:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690608.106291:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106298:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690608.106301:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106308:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106317:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106323:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4499a90/0xb4bb873a191409ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690608.106349:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690608.106351:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690608.106353:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1779690608.106363:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000001:00080000:2.0:1779690608.106399:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902454 is committed 00000004:00080000:2.0:1779690608.106403:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00010000:00010000:0.0:1779690608.106921:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1779690608.109142:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f8308ad80/2, rc 0, transno 4294968463 00000100:00100000:3.0:1779690608.109156:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492372480:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1779690608.521998:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690608.522005:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690608.522050:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 49 count 13 00000040:00080000:2.0:1779690608.522057:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690608.522329:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372608:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690608.523497:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f826e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1779690608.527018:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372608:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1779690608.598068:0:73747:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690608.598075:0:73747:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690608.598147:0:73747:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 49 count 13 00000040:00080000:2.0:1779690608.598154:0:73747:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690608.633385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690608.633439:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503841920 00000100:00100000:3.0:1779690608.633448:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503841920 00000100:00100000:3.0:1779690608.633535:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1214 00000100:00100000:3.0:1779690608.633546:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+64:112466:x1866137503841920:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690608.633565:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690608.633584:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee609 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.633755:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.633770:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.633794:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634163:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634173:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634180:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634543:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634558:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634565:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690608.634600:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00000004:00200000:3.0:1779690608.634605:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690608.634623:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634635:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634654:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634660:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634666:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634672:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4aa00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690608.634676:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634684:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634696:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:3.0:1779690608.634705:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690608.634711:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634718:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a191409fa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634729:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634735:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634742:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634747:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ae00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690608.634750:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634756:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634765:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x9838e759 (ffff9e2f905ada00) 00010000:00010000:3.0:1779690608.634768:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690608.634771:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634777:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140a01 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634832:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a191409f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee609 expref: 66 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634854:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee609 expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.634862:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690608.634864:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1779690608.634866:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b200, rc 0) 00000100:00100000:3.0:1779690608.634925:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+65:112466:x1866137503841920:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1381us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690608.634934:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1214 00000100:00100000:1.0:1779690608.641243:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690608.641321:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842176 00000100:00100000:3.0:1779690608.641330:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842176 00000100:00100000:3.0:1779690608.641398:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18692 00000100:00100000:3.0:1779690608.641409:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:112466:x1866137503842176:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:3.0:1779690608.641426:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690608.641450:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140a08 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee609 expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.641469:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ad000) 00010000:00010000:3.0:1779690608.641481:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690608.641549:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e775ff0e-5641-488a-99d7-1331a4992115+64:112466:x1866137503842176:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 141us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690608.641557:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18692 00000100:00100000:0.0:1779690608.646556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690608.646621:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842304 00000100:00100000:3.0:1779690608.646631:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842304 00000100:00100000:3.0:1779690608.646700:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1215 00000100:00100000:3.0:1779690608.646719:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+64:112466:x1866137503842304:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:3.0:1779690608.646865:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.646884:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690608.646896:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1779690608.647199:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].49, 136 off14856 00000100:00100000:3.0:1779690608.647299:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+64:112466:x1866137503842304:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 582us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690608.647307:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1215 00000100:00100000:0.0:1779690608.673519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690608.673594:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842432 00000100:00100000:1.0:1779690608.673604:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842432 00000100:00100000:1.0:1779690608.673673:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1216 00000100:00100000:1.0:1779690608.673684:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:112468:x1866137503842432:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690608.673706:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690608.673735:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140a16 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee610 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673851:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673868:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673879:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673893:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673898:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.673904:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674280:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674290:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674298:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690608.674335:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00000004:00200000:1.0:1779690608.674339:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690608.674358:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674381:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674629:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674645:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674652:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674658:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690608.674662:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674670:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674682:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690608.674685:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690608.674690:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674696:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a1d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674706:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674712:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674725:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674730:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690608.674733:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674740:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674748:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x9838e759 (ffff9e2f90442800) 00010000:00010000:1.0:1779690608.674751:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690608.674754:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674760:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a24 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674794:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871600/0xb4bb873a19140a16 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee610 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674899:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870800/0xb4bb873a19140a2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee610 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690608.674908:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:1.0:1779690608.674910:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690608.674913:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870800, rc 0) 00000100:00100000:1.0:1779690608.675061:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:112468:x1866137503842432:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1377us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690608.675080:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1216 00010000:00010000:2.0:1779690609.100615:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690609.185076:0:73798:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690609.185084:0:73798:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690609.185379:0:73798:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 50 count 14 00000040:00080000:3.0:1779690609.185384:0:73798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690609.545050:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690609.545058:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690609.545115:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 50 count 14 00000040:00080000:0.0:1779690609.545122:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690609.545237:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372736:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690609.545371:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30847e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1779690609.548087:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372736:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690610.115124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.115214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690610.115306:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842816 00000100:00100000:1.0:1779690610.115316:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842816 00000100:00100000:1.0:1779690610.115392:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3003 00000100:00100000:1.0:1779690610.115404:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503842816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690610.115474:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503842816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690610.115483:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3003 00000100:00080000:0.0:1779690610.115760:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690610.116341:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842560 00000100:00100000:3.0:1779690610.116348:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842560 00000100:00100000:3.0:1779690610.116388:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:3.0:1779690610.116396:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503842560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690610.119898:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503842560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3492us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690610.119912:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 215 00010000:00010000:2.0:1779690610.123867:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690610.124350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.124380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.124411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.124431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.124457:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690610.124481:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843328 00000100:00100000:0.0:1779690610.124490:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843328 00000100:00100000:0.0:1779690610.124541:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842944 00000100:00100000:0.0:1779690610.124544:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842944 00000100:00100000:0.0:1779690610.124563:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843200 00000100:00100000:0.0:1779690610.124565:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843200 00000100:00100000:0.0:1779690610.124589:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3004 00000100:00100000:0.0:1779690610.124598:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503843328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690610.124666:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503843328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690610.124673:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3004 00000100:00100000:0.0:1779690610.124691:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3005 00000100:00100000:0.0:1779690610.124698:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503842944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690610.124721:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503842944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690610.124727:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3005 00000100:00100000:0.0:1779690610.124738:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3006 00000100:00100000:0.0:1779690610.124744:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503843200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690610.124781:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503843200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690610.124787:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3006 00000100:00080000:0.0:1779690610.124834:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690610.124838:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690610.125840:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843072 00000100:00100000:3.0:1779690610.125848:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843072 00000100:00100000:3.0:1779690610.125951:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503842688 00000100:00100000:3.0:1779690610.125955:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503842688 00000100:00080000:0.0:1779690610.128874:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690610.129104:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 316 00000100:00100000:2.0:1779690610.129122:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2391:x1866137503843072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690610.129203:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2391:x1866137503843072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 89us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690610.129209:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 316 00000100:00100000:2.0:1779690610.129233:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 317 00000100:00100000:2.0:1779690610.129251:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503842688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690610.129279:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+59:2392:x1866137503842688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690610.129284:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 317 00000040:00080000:2.0:1779690610.570064:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690610.570072:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690610.570133:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 50 count 14 00000040:00080000:2.0:1779690610.570141:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690610.796270:0:73849:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690610.796278:0:73849:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690610.796369:0:73849:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 50 count 14 00000040:00080000:0.0:1779690610.796375:0:73849:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690610.844392:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690610.844480:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843584 00000100:00100000:3.0:1779690610.844488:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843584 00000100:00100000:3.0:1779690610.844542:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1217 00000100:00100000:3.0:1779690610.844551:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:112487:x1866137503843584:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690610.844978:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].50, 136 off14992 00000100:00100000:3.0:1779690610.845065:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:112487:x1866137503843584:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 514us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690610.845073:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1217 00010000:00010000:0.0:1779690611.145149:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690611.387277:0:73900:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690611.387285:0:73900:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690611.387372:0:73900:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 51 count 15 00000040:00080000:2.0:1779690611.387379:0:73900:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690611.593047:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690611.593057:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690611.593105:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 51 count 15 00000040:00080000:2.0:1779690611.593114:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690611.593226:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372864:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1779690611.593952:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138f00 going to sleep for 11 seconds 00000100:00100000:2.0:1779690611.597870:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492372864:192.168.203.5@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1779690612.169069:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690612.205063:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968463 is committed 00000040:00080000:2.0:1779690612.617533:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690612.617543:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690612.618535:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 51 count 14 00000040:00080000:2.0:1779690612.618545:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690612.682479:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492372992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690612.682536:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690612.682609:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492372992 00000100:00100000:1.0:1779690612.682615:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492372992 00000100:00100000:1.0:1779690612.682660:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1779690612.682668:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492372992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690612.682698:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690612.682734:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492372992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.682740:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:1.0:1779690612.682758:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690612.682786:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492372992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690612.683070:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690612.683080:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f89d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492373120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690612.683117:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690612.683177:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492373120 00000100:00100000:0.0:1779690612.683182:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492373120 00000100:00100000:0.0:1779690612.683236:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1779690612.683244:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492373120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690612.683263:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690612.683296:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492373120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690612.683302:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1779690612.683895:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492373632:0@lo:400:kworker.0 00000100:00100000:1.0:1779690612.683932:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492373248:0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.683939:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690612.683971:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690612.683994:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690612.684003:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492373504:0@lo:400:kworker.0 00000100:00100000:1.0:1779690612.684010:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690612.684018:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492373376:0@lo:400:kworker.0 00000100:00100000:1.0:1779690612.684057:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492373248 00000100:00100000:1.0:1779690612.684062:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492373248 00000100:00100000:2.0:1779690612.684102:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690612.684130:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1779690612.684140:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492373248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690612.684172:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492373248:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.684177:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1779690612.684193:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492373632 00000100:00100000:2.0:1779690612.684198:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492373632 00000100:00100000:2.0:1779690612.684232:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492373504 00000100:00100000:2.0:1779690612.684235:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492373504 00000100:00100000:1.0:1779690612.684249:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1779690612.684258:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492373632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.684356:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1779690612.684366:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492373504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690612.684400:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492373632:12345-0@lo:400:kworker.0 Request processed in 144us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.684408:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1779690612.684412:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492373504:12345-0@lo:400:kworker.0 Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690612.684419:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1779690612.684549:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492373504:0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.684561:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492373632:0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.684580:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690612.684617:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492373248:0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.684642:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492373376 00000100:00100000:2.0:1779690612.684645:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492373376 00000100:00100000:2.0:1779690612.684673:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1779690612.684680:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492373376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690612.684712:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492373376:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690612.684717:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1779690612.684739:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492373376:0@lo:400:kworker.0 00000100:00080000:2.0:1779690612.685850:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690612.685856:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690612.685892:0:3318:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968463 gen 2 00000004:00080000:2.0:1779690612.685899:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f8308ad80, transno 4294968463 00000100:00100000:2.0:1779690612.685921:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f89d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492373120:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1779690612.936141:0:73953:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690612.936147:0:73953:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690612.936313:0:73953:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 51 count 14 00000040:00080000:1.0:1779690612.936320:0:73953:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690612.966632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690612.966729:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843712 00000100:00100000:1.0:1779690612.966738:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843712 00000100:00100000:1.0:1779690612.966925:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1218 00000100:00100000:1.0:1779690612.966933:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+65:112508:x1866137503843712:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690612.966949:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690612.967492:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140a32 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee617 expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967555:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967577:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967660:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967680:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967688:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.967695:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968140:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968151:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968158:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690612.968189:0:64445:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2d:0x0]: returning size 0 00000004:00200000:1.0:1779690612.968193:0:64445:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690612.968212:0:64445:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968222:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968243:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968249:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968255:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968260:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690612.968265:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968271:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968293:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690612.968296:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690612.968308:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968315:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a39 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968326:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968333:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968339:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968361:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690612.968364:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968370:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968379:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0xa2905c76 (ffff9e2f90442c00) 00010000:00010000:1.0:1779690612.968382:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690612.968384:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968390:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a40 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968422:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140a32 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee617 expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968435:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870400/0xb4bb873a19140a47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee617 expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.968441:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2d:0x0].0x0 (ffff9e2f90226c00) 00010000:00010000:1.0:1779690612.968444:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690612.968447:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85870400, rc 0) 00000100:00100000:1.0:1779690612.968516:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+66:112508:x1866137503843712:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1583us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.968525:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1218 00000100:00080000:1.0:1779690612.968561:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690612.970922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690612.971569:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503843840 00000100:00100000:1.0:1779690612.971579:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503843840 00000100:00100000:1.0:1779690612.971867:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6536 00000100:00100000:1.0:1779690612.971878:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503843840:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690612.971893:0:15940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690612.971910:0:15940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000941c9bff/0xb4bb873a19140a4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee61e expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690612.971935:0:15940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:2.0:1779690612.971952:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1779690612.971953:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690612.971957:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690612.971967:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000941c9bff/0xb4bb873a19140a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee61e expref: 11 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.971985:0:15940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000941c9bff/0xb4bb873a19140a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee61e expref: 11 pid: 15940 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.971998:0:15940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f85871600, rc 0) 00000100:00100000:1.0:1779690612.972071:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+11:2390:x1866137503843840:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 196us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.972078:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6536 00000100:00100000:2.0:1779690612.975779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690612.975902:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844096 00000100:00100000:3.0:1779690612.975910:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844096 00000100:00100000:3.0:1779690612.975962:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1219 00000100:00100000:3.0:1779690612.975971:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:112508:x1866137503844096:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690612.976473:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].51, 136 off15128 00000100:00100000:3.0:1779690612.976605:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:112508:x1866137503844096:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 622us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690612.976615:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1219 00000100:00100000:2.0:1779690612.995299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690612.996901:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844224 00000100:00100000:1.0:1779690612.996908:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844224 00000100:00100000:1.0:1779690612.996962:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1220 00000100:00100000:1.0:1779690612.996969:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+66:112509:x1866137503844224:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690612.996985:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690612.997000:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140a55 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee625 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997106:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997119:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997127:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997138:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997142:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997146:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997885:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997896:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997904:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690612.997939:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2f:0x0]: returning size 0 00000004:00200000:1.0:1779690612.997944:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690612.997962:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997984:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997992:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.997998:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998005:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998011:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85870e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690612.998015:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998021:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998032:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690612.998035:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690612.998038:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998564:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870e00/0xb4bb873a19140a5c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998580:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998586:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998610:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998616:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f85871c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690612.998618:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998624:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998633:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x1313e569 (ffff9e2f90442c00) 00010000:00010000:1.0:1779690612.998635:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690612.998638:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998643:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871c00/0xb4bb873a19140a63 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998679:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871400/0xb4bb873a19140a55 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee625 expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998693:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee625 expref: 67 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690612.998701:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:1.0:1779690612.998704:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1779690612.998706:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4403a00, rc 0) 00000100:00100000:1.0:1779690612.998834:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+67:112509:x1866137503844224:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1864us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690612.998852:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1220 00000100:00100000:2.0:1779690613.007094:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690613.007143:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844480 00000100:00100000:1.0:1779690613.007153:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844480 00000100:00100000:1.0:1779690613.007222:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18693 00000100:00100000:1.0:1779690613.007233:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+67:112509:x1866137503844480:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:1.0:1779690613.007247:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690613.007280:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403a00/0xb4bb873a19140a6a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee625 expref: 67 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690613.007297:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90442a00) 00010000:00010000:1.0:1779690613.007307:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690613.007359:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e775ff0e-5641-488a-99d7-1331a4992115+66:112509:x1866137503844480:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690613.007367:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18693 00000100:00100000:2.0:1779690613.009679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690613.009899:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844608 00000100:00100000:1.0:1779690613.009908:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844608 00000100:00100000:1.0:1779690613.009964:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1221 00000100:00100000:1.0:1779690613.009976:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:112509:x1866137503844608:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:1.0:1779690613.010071:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690613.010088:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690613.010101:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1779690613.010393:0:57561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].52, 136 off15264 00000100:00100000:1.0:1779690613.011773:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:112509:x1866137503844608:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 520us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690613.011789:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1221 00000100:00100000:1.0:1779690613.025258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690613.025330:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844864 00000100:00100000:3.0:1779690613.025339:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844864 00000100:00100000:3.0:1779690613.025391:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1222 00000100:00100000:3.0:1779690613.025401:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:112510:x1866137503844864:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1779690613.025721:0:57560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].53, 136 off15400 00000100:00100000:3.0:1779690613.025801:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+66:112510:x1866137503844864:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 401us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690613.025832:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1222 00010000:00010000:2.0:1779690613.192956:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690613.226864:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968359 is committed 00000040:00080000:2.0:1779690613.641007:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690613.641014:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690613.641058:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 17 00000040:00080000:2.0:1779690613.641067:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690614.217616:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690614.526776:0:74006:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690614.526784:0:74006:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690614.526987:0:74006:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 17 00000040:00080000:0.0:1779690614.526993:0:74006:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690614.665076:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690614.665085:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690614.668309:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:2.0:1779690614.668321:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690615.235052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690615.235244:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845376 00000100:00100000:2.0:1779690615.235254:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845376 00000100:00100000:2.0:1779690615.235348:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845632 00000100:00100000:2.0:1779690615.235352:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845632 00000100:00100000:2.0:1779690615.235381:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845248 00000100:00100000:2.0:1779690615.235384:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845248 00000100:00100000:2.0:1779690615.235399:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845760 00000100:00100000:2.0:1779690615.235401:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845760 00000100:00100000:2.0:1779690615.235420:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3007 00000100:00100000:2.0:1779690615.235428:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503845376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690615.235492:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503845376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 64us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690615.235499:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3007 00000100:00100000:2.0:1779690615.235513:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3008 00000100:00100000:2.0:1779690615.235519:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503845632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690615.235539:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503845632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690615.235545:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3008 00000100:00100000:1.0:1779690615.235555:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3009 00000100:00100000:1.0:1779690615.235567:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503845248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690615.235614:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+8:2392:x1866137503845248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690615.235675:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845120 00000100:00100000:3.0:1779690615.235681:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845120 00000100:00100000:3.0:1779690615.235738:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845504 00000100:00100000:3.0:1779690615.235742:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845504 00000100:00100000:3.0:1779690615.235766:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 321 00000100:00100000:3.0:1779690615.235774:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503845120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690615.235830:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+59:2391:x1866137503845120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 56us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690615.235839:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 321 00000100:00100000:3.0:1779690615.235857:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 322 00000100:00100000:3.0:1779690615.235864:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+66:2392:x1866137503845504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690615.235906:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+66:2392:x1866137503845504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690615.235913:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 322 00000100:00100000:2.0:1779690615.236581:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3010 00000100:00100000:2.0:1779690615.236593:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+11:2392:x1866137503845760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690615.236626:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+11:2392:x1866137503845760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690615.236632:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3010 00000100:00080000:2.0:1779690615.236651:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690615.236656:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690615.236658:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690615.237006:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3009 00000100:00100000:1.0:1779690615.237309:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503844992 00000100:00100000:1.0:1779690615.237315:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503844992 00000100:00100000:1.0:1779690615.237615:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:1.0:1779690615.237624:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503844992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690615.237662:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503844992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690615.237669:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 217 00010000:00010000:2.0:1779690615.241857:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690615.689609:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690615.689616:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690615.689681:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:2.0:1779690615.689701:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690616.265927:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690616.713974:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690616.713982:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690616.714024:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:0.0:1779690616.714031:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690617.288995:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.289026:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503845888 00000100:00100000:1.0:1779690617.289038:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503845888 00000100:00100000:0.0:1779690617.289080:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.289108:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846016 00000100:00100000:0.0:1779690617.289112:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846016 00000100:00100000:1.0:1779690617.289117:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1223 00000100:00080000:3.0:1779690617.289130:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690617.289131:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:112944:x1866137503845888:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.289147:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1224 00000100:00100000:0.0:1779690617.289157:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+60:112946:x1866137503846016:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690617.289164:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1779690617.289174:0:57585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x30:0x0] from 18446744073709551615 #0 00010000:00010000:2.0:1779690617.289243:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690617.289284:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+60:112946:x1866137503846016:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 126us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.289286:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+60:112944:x1866137503845888:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 155us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.289297:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1223 00000100:00100000:0.0:1779690617.289435:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1224 00000100:00100000:3.0:1779690617.291428:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.291517:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846272 00000100:00100000:0.0:1779690617.291525:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846272 00000100:00100000:0.0:1779690617.291654:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1225 00000100:00100000:0.0:1779690617.291664:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+59:112946:x1866137503846272:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.291681:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.291714:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140a78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee62c expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.291840:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140a7f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.291856:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140a7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.291867:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140a7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.291878:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x30:0x0]: returning size 0 00010000:00010000:0.0:1779690617.292019:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140a78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee62c expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.292048:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140a7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee62c expref: 61 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.292057:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:0.0:1779690617.292060:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690617.292063:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:0.0:1779690617.292110:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+61:112946:x1866137503846272:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 449us (690us total) trans 12884902465 rc 0/0 00000100:00100000:0.0:1779690617.292126:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1225 00000100:00100000:3.0:1779690617.292400:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.292692:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846400 00000100:00100000:2.0:1779690617.292697:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846400 00000100:00100000:2.0:1779690617.292732:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1226 00000100:00100000:2.0:1779690617.292739:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+61:112945:x1866137503846400:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1779690617.292757:0:57559:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1779690617.292846:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+61:112945:x1866137503846400:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.292854:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1226 00000100:00100000:3.0:1779690617.293959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.294009:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846656 00000100:00100000:0.0:1779690617.294015:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846656 00000100:00100000:0.0:1779690617.294055:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1227 00000100:00100000:0.0:1779690617.294064:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+61:112944:x1866137503846656:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.294083:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.294099:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140a8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee633 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.294182:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140a94 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.294196:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140a94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.294206:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140a94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.294216:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2c:0x0]: returning size 0 00010000:00010000:0.0:1779690617.294335:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282800/0xb4bb873a19140a8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee633 expref: 64 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.294353:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140a94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee633 expref: 63 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.294361:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:0.0:1779690617.294364:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690617.294368:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690617.294408:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:112944:x1866137503846656:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 345us (449us total) trans 12884902466 rc 0/0 00000100:00100000:0.0:1779690617.294417:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1227 00000100:00100000:3.0:1779690617.297347:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.297579:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846784 00000100:00100000:1.0:1779690617.297587:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846784 00000100:00100000:1.0:1779690617.297708:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6537 00000100:00100000:1.0:1779690617.297720:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503846784:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.297772:0:15940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297789:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690617.297791:0:15940:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690617.297796:0:15940:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297832:0:15940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297872:0:15940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297881:0:15940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297895:0:15940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297925:0:15940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403600 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:1.0:1779690617.297929:0:15940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297937:0:15940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297960:0:15940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.297968:0:15940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222eb1ea/0xb4bb873a19140aa2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.298041:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+8:2391:x1866137503846784:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 323us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.298048:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6537 00000100:00100000:3.0:1779690617.298496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.299060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.299138:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503847040 00000100:00100000:0.0:1779690617.299145:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503847040 00000100:00100000:0.0:1779690617.299193:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1228 00000100:00100000:0.0:1779690617.299202:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112945:x1866137503847040:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.299264:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299279:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299288:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299329:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299336:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299352:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299379:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299386:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299393:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.299427:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00000004:00200000:0.0:1779690617.299431:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690617.299441:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299453:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299460:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299467:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299472:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30bf53ee00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.299476:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299482:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299499:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690617.299502:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690617.299507:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299513:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30bf53ee00/0xb4bb873a19140aa9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299527:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299532:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299538:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299543:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.299546:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299561:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299568:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2f0ac633 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690617.299570:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690617.299573:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299578:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140ab0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2f0ac633 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299604:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299610:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299616:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299621:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.299624:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299630:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299638:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:0.0:1779690617.299641:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690617.299644:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.299649:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ab7 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.299652:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503846912 00000100:00100000:1.0:1779690617.299658:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503846912 00000100:00100000:1.0:1779690617.299703:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18694 00000100:00100000:0.0:1779690617.299710:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:112945:x1866137503847040:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 508us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.299714:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+64:2391:x1866137503846912:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1779690617.299723:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1228 00010000:00010000:1.0:1779690617.299727:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690617.299756:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140a94 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee633 expref: 63 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.299770:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:1.0:1779690617.299781:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690617.299820:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+62:2391:x1866137503846912:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 93us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.299828:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18694 00000100:00080000:2.0:1779690617.299928:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690617.302044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.302086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.302106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.302178:0:5779:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503847424 00000100:00100000:2.0:1779690617.302187:0:5779:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503847424 00000100:00100000:2.0:1779690617.302241:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18695 00000100:00100000:2.0:1779690617.302250:0:5779:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+62:2391:x1866137503847424:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1779690617.302273:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1779690617.302294:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140a7f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee62c expref: 62 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.302311:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:2.0:1779690617.302316:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1779690617.302362:0:5779:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7a1272b-3551-4679-9948-3e2276470519+61:2391:x1866137503847424:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.302369:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18695 00000100:00100000:1.0:1779690617.302451:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503847296 00000100:00100000:0.0:1779690617.302453:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503847680 00000100:00100000:1.0:1779690617.302456:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503847296 00000100:00100000:0.0:1779690617.302459:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503847680 00000100:00100000:1.0:1779690617.302495:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1229 00000100:00100000:1.0:1779690617.302503:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+62:112946:x1866137503847296:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.302574:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302589:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302598:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.302758:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1230 00000100:00100000:0.0:1779690617.302781:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:112945:x1866137503847680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.302792:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.302822:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140ac5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee63a expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302827:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302837:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302844:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302859:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690617.302863:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.302873:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302888:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302897:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302905:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.302914:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x2e:0x0]: returning size 0 00010000:00010000:0.0:1779690617.302964:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302971:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302978:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302984:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.302987:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.302993:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.303066:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x30:0x0].0x0 (ffff9e30bf50fe00) 00010000:00010000:1.0:1779690617.303070:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690617.303076:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303076:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:1.0:1779690617.303084:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140abe lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303085:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690617.303091:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303098:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140acc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303137:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140ac5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee63a expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303146:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:0.0:1779690617.303149:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690617.303153:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140ac5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee63a expref: 65 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.303164:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8400, rc 0) 00000100:00100000:0.0:1779690617.303308:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+64:112945:x1866137503847680:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 528us (1199us total) trans 12884902468 rc 301/301 00000100:00100000:0.0:1779690617.303314:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1230 00000100:00100000:1.0:1779690617.304687:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:112946:x1866137503847296:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 2179us (2643us total) trans 12884902467 rc 0/0 00000100:00100000:1.0:1779690617.304698:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1229 00000100:00100000:3.0:1779690617.305278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.305361:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503847936 00000100:00100000:2.0:1779690617.305370:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503847936 00000100:00100000:2.0:1779690617.305434:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1231 00000100:00100000:2.0:1779690617.305444:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112944:x1866137503847936:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1779690617.305528:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112944:x1866137503847936:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.305535:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1231 00000100:00100000:0.0:1779690617.308800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.309094:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503848192 00000100:00100000:1.0:1779690617.309103:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503848192 00000100:00100000:1.0:1779690617.309154:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:1.0:1779690617.309164:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+63:112946:x1866137503848192:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690617.309332:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.309490:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503848320 00000100:00100000:0.0:1779690617.309495:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503848320 00000100:00100000:0.0:1779690617.309537:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6538 00000100:00100000:0.0:1779690617.309545:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+8:2389:x1866137503848320:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.309566:0:22279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.309583:0:22279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032a4cf32/0xb4bb873a19140ada lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee641 expref: -99 pid: 22279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.309622:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690617.309624:0:22279:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1779690617.309632:0:22279:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032a4cf32/0xb4bb873a19140ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee641 expref: 9 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.309649:0:22279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032a4cf32/0xb4bb873a19140ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee641 expref: 9 pid: 22279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.309668:0:22279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b282800, rc 0) 00000100:00100000:0.0:1779690617.309722:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503848320:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.309730:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6538 00000100:00100000:1.0:1779690617.310273:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+64:112946:x1866137503848192:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1109us (1479us total) trans 12884902469 rc 0/0 00000100:00100000:1.0:1779690617.310281:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:2.0:1779690617.316209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.316338:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503848448 00000100:00100000:3.0:1779690617.316348:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503848448 00000100:00100000:3.0:1779690617.316416:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1232 00000100:00100000:3.0:1779690617.316426:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+64:112945:x1866137503848448:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1779690617.316463:0:57560:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1779690617.316598:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+64:112945:x1866137503848448:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 172us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.316605:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1232 00000100:00100000:2.0:1779690617.317085:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.317627:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503848704 00000100:00100000:1.0:1779690617.317634:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503848704 00000100:00100000:1.0:1779690617.317688:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1233 00000100:00100000:1.0:1779690617.317700:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+64:112944:x1866137503848704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1779690617.317790:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+64:112944:x1866137503848704:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 94us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.317797:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1233 00000100:00100000:2.0:1779690617.321214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.321298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.321433:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503848960 00000100:00100000:0.0:1779690617.321443:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503848960 00000100:00100000:0.0:1779690617.321502:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849088 00000100:00100000:0.0:1779690617.321505:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849088 00000100:00100000:0.0:1779690617.321538:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1234 00000100:00100000:0.0:1779690617.321557:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:112945:x1866137503848960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.321577:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.321596:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140ae1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee648 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.321635:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1235 00000100:00100000:1.0:1779690617.321659:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:112944:x1866137503849088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.321668:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690617.321680:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140ae8 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee64f expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321704:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321717:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321728:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321834:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140ae8 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321854:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 67 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.321862:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:1.0:1779690617.321865:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1779690617.321869:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4403600, rc 0) 00000100:00100000:1.0:1779690617.321931:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+67:112944:x1866137503849088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 274us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.321938:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1235 00010000:00010000:0.0:1779690617.325173:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140af6 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.325193:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.325213:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.325225:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x32:0x0]: returning size 0 00010000:00010000:0.0:1779690617.325280:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140ae1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee648 expref: 68 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.325297:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee648 expref: 67 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.325305:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:0.0:1779690617.325308:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690617.325311:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690617.325777:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:112945:x1866137503848960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 4228us (4570us total) trans 12884902470 rc 0/0 00000100:00100000:0.0:1779690617.325786:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1234 00000100:00100000:2.0:1779690617.326491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.326755:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849216 00000100:00100000:1.0:1779690617.326762:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849216 00000100:00100000:1.0:1779690617.326838:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1236 00000100:00100000:1.0:1779690617.326856:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+67:112944:x1866137503849216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1779690617.326883:0:64445:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd3:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1779690617.326962:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+67:112944:x1866137503849216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 108us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.326969:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1236 00000100:00100000:0.0:1779690617.329269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.329329:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849472 00000100:00100000:1.0:1779690617.329337:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849472 00000100:00100000:1.0:1779690617.329387:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1237 00000100:00100000:1.0:1779690617.329397:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+67:112945:x1866137503849472:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.329449:0:57561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690617.329473:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140af6 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee648 expref: 67 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.329490:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f000) 00010000:00010000:1.0:1779690617.329500:0:57561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1779690617.329519:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.329533:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.329541:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.329582:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.329595:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 65 pid: 64445 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.329624:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492373760:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690617.329723:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1779690617.332181:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.332274:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849600 00000100:00100000:2.0:1779690617.332282:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849600 00000100:00100000:2.0:1779690617.332333:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6539 00000100:00100000:2.0:1779690617.332343:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503849600:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1779690617.332381:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332395:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690617.332397:0:6583:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1779690617.332402:0:6583:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332415:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332442:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332459:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332467:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332474:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2da00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690617.332478:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332488:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332503:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.332510:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004844285d/0xb4bb873a19140b0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1779690617.332592:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503849600:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 251us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.332599:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6539 00000100:00100000:1.0:1779690617.333597:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492373760:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690617.333621:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.333704:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.333768:0:5781:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849728 00000100:00100000:3.0:1779690617.333773:0:5781:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849728 00010000:00010000:3.0:1779690617.333841:0:5781:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 66 pid: 64445 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690617.333867:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3348 00000100:00100000:3.0:1779690617.333876:0:5781:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:2391:x1866137503849728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690617.333888:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690617.333893:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 66 pid: 64445 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333904:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 66 pid: 64445 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333921:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a1914091a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5bc expref: 66 pid: 64445 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333934:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:3.0:1779690617.333938:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333960:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333966:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.333990:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690617.334037:0:5781:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e775ff0e-5641-488a-99d7-1331a4992115+65:2391:x1866137503849728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 162us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.334045:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3348 00010000:00010000:1.0:1779690617.334282:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334290:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334309:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334317:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334323:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334539:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334546:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334565:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334581:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4402e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690617.334585:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334592:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334600:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:1.0:1779690617.334603:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690617.334606:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334611:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402e00/0xb4bb873a19140b04 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x96:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334621:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334627:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334632:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334637:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690617.334639:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334644:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334659:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x64853e9a (ffff9e2f90442700) 00010000:00010000:1.0:1779690617.334661:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690617.334663:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.334668:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403c00/0xb4bb873a19140b12 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x96:0x0].0x64853e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.334727:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+66:112945:x1866137503849472:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 5331us (5465us total) trans 0 rc -2/-2 00000100:00100000:1.0:1779690617.334734:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1237 00000100:00080000:2.0:1779690617.335143:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690617.335410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.335443:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503849984 00000100:00100000:1.0:1779690617.335449:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503849984 00000100:00100000:1.0:1779690617.335490:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1238 00000100:00100000:1.0:1779690617.335496:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+66:112944:x1866137503849984:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.335542:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.335578:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 66 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.335587:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.335678:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 66 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.335691:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 66 pid: 57561 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.335712:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492373888:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690617.335765:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30bfc2bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1779690617.337885:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492373888:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690617.337908:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690617.338014:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.338049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.338090:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503850240 00000100:00100000:1.0:1779690617.338097:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503850240 00010000:00010000:1.0:1779690617.338126:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 67 pid: 57561 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.338161:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3349 00000100:00100000:1.0:1779690617.338173:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+67:2392:x1866137503850240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690617.338186:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690617.338191:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 67 pid: 57561 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338201:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 67 pid: 57561 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338219:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403600/0xb4bb873a19140aef lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee64f expref: 67 pid: 57561 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338233:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:1.0:1779690617.338237:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338256:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338263:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.338299:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690617.338351:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+66:2392:x1866137503850240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 182us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.338358:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3349 00010000:00010000:0.0:1779690617.338418:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338425:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338638:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338656:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338662:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338668:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403000 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.338672:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338680:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338690:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2c:0x0].0x0 (ffff9e2f90442b00) 00010000:00010000:0.0:1779690617.338693:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690617.338697:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338702:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403000/0xb4bb873a19140b19 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.338868:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+66:112944:x1866137503849984:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 3368us (3455us total) trans 12884902471 rc 0/0 00000100:00100000:0.0:1779690617.338877:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1238 00000100:00100000:0.0:1779690617.338893:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503850112 00000100:00100000:0.0:1779690617.338897:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503850112 00000100:00100000:0.0:1779690617.338929:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1239 00000100:00100000:0.0:1779690617.338936:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+66:112945:x1866137503850112:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.338950:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.338969:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140b20 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee656 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.338994:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140b27 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.339002:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140b27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.339009:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140b27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.339077:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b282000/0xb4bb873a19140b20 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee656 expref: 68 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.339090:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283400/0xb4bb873a19140b27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee656 expref: 67 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.339102:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:0.0:1779690617.339104:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1779690617.339107:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283400, rc 0) 00000100:00100000:0.0:1779690617.339141:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+67:112945:x1866137503850112:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 206us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.339148:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1239 00000100:00100000:3.0:1779690617.340664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690617.340858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.341003:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503850752 00000100:00100000:0.0:1779690617.341010:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503850752 00000100:00100000:0.0:1779690617.341048:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1240 00000100:00100000:0.0:1779690617.341057:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+67:112945:x1866137503850752:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.341121:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.341147:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.341154:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690617.341281:0:57561:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000047d06f27 reply state 00000000b345cb75 transno 12884902472 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.341287:0:57561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1779690617.341537:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503850496 00000100:00100000:1.0:1779690617.341541:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503850496 00000100:00100000:1.0:1779690617.341584:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:1.0:1779690617.341590:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+70:112944:x1866137503850496:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.341961:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503850752:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 904us (1102us total) trans 12884902472 rc 0/0 00000100:00100000:0.0:1779690617.341970:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1240 00000100:00100000:1.0:1779690617.342070:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+70:112944:x1866137503850496:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 479us (1411us total) trans 12884902473 rc 0/0 00000100:00100000:1.0:1779690617.342078:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:1.0:1779690617.345231:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:2.0:1779690617.345312:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345341:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345348:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345353:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f8b283800 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690617.345358:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345366:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345383:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:2.0:1779690617.345386:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1779690617.345391:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.345397:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140b2e lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690617.345429:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503850880 00000100:00100000:3.0:1779690617.345438:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503850880 00000100:00100000:3.0:1779690617.345487:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1241 00000100:00100000:3.0:1779690617.345496:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+69:112945:x1866137503850880:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1779690617.345519:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690617.345534:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee65d expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.345594:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 70 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.345616:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 70 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690617.345633:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:3.0:1779690617.345635:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1779690617.345639:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4ae00, rc 0) 00000100:00100000:3.0:1779690617.345802:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+70:112945:x1866137503850880:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 306us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.345840:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1241 00000100:00100000:2.0:1779690617.351956:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.352048:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503851008 00000100:00100000:0.0:1779690617.352059:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503851008 00000100:00100000:0.0:1779690617.352118:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:0.0:1779690617.352127:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f84315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+70:112945:x1866137503851008:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.352249:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f84315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+70:112945:x1866137503851008:12345-192.168.203.5@tcp:49:lhsmtool_posix.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.352256:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:0.0:1779690617.356774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.356927:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503851264 00000100:00100000:2.0:1779690617.356936:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503851264 00000100:00100000:2.0:1779690617.356987:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:2.0:1779690617.356999:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+70:112945:x1866137503851264:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1779690617.357224:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503851264:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 227us (458us total) trans 12884902474 rc 0/0 00000100:00100000:2.0:1779690617.357231:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:1.0:1779690617.358798:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.358904:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503851520 00000100:00100000:0.0:1779690617.358912:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503851520 00000100:00100000:0.0:1779690617.358998:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1242 00000100:00100000:0.0:1779690617.359016:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503851520:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.359092:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503851520:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.359106:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1242 00000100:00100000:3.0:1779690617.360615:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.360772:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503851776 00000100:00100000:0.0:1779690617.360780:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503851776 00000100:00100000:0.0:1779690617.360860:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1243 00000100:00100000:0.0:1779690617.360869:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503851776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1779690617.360885:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690617.360904:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b3c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee664 expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.361000:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.361016:0:57561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 2/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 72 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.361025:0:57561:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.361060:0:57561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 72 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.361073:0:57561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 72 pid: 57560 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.361087:0:57561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492374016:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690617.361159:0:57561:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e30ae66e480 going to sleep for 11 seconds 00000100:00100000:0.0:1779690617.364013:0:57561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:57561:1866137492374016:192.168.203.5@tcp:104: 00010000:00010000:0.0:1779690617.364059:0:57561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690617.364611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.364985:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503851904 00000100:00100000:1.0:1779690617.364991:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503851904 00010000:00010000:1.0:1779690617.365025:0:7464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 73 pid: 57560 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690617.365108:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3350 00000100:00100000:1.0:1779690617.365119:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+73:2392:x1866137503851904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690617.365142:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690617.365150:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 73 pid: 57560 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365162:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 73 pid: 57560 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365181:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b35 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee65d expref: 73 pid: 57560 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365196:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:1.0:1779690617.365200:0:7464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365209:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365216:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.365251:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690617.365306:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+72:2392:x1866137503851904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 188us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.365313:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3350 00010000:00010000:0.0:1779690617.365368:0:57561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.365375:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690617.365392:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x32:0x0]: returning size 0 00000004:00080000:0.0:1779690617.366091:0:57561:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f6:0x0], index 0: 0 00010000:00010000:0.0:1779690617.366195:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366201:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366205:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366209:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690617.366211:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366217:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366235:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:0.0:1779690617.366237:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690617.366239:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366251:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b43 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366290:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b3c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee664 expref: 72 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366296:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x96:0x0].0x0 (ffff9e30bf50f100) 00010000:00010000:0.0:1779690617.366297:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1779690617.366300:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b3c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x96:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee664 expref: 72 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.366305:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8e00, rc 0) 00000100:00100000:0.0:1779690617.366339:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503851776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5471us (5730us total) trans 12884902475 rc 301/301 00000100:00100000:0.0:1779690617.366346:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1243 00000100:00100000:3.0:1779690617.368970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.369053:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852160 00000100:00100000:1.0:1779690617.369062:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852160 00000100:00100000:1.0:1779690617.369161:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:1.0:1779690617.369180:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+71:112945:x1866137503852160:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1779690617.369509:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+72:112945:x1866137503852160:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 338us (544us total) trans 12884902476 rc 0/0 00000100:00100000:1.0:1779690617.369516:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:3.0:1779690617.370912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.371261:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852288 00000100:00100000:2.0:1779690617.371269:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852288 00000100:00100000:2.0:1779690617.371327:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1244 00000100:00100000:2.0:1779690617.371336:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+72:112945:x1866137503852288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1779690617.371356:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690617.371374:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140b51 lrc: 2/0,0 mode: --/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee66b expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371433:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140b58 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371446:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371457:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690617.371487:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x32:0x0]: returning size 0 00000004:00200000:2.0:1779690617.371491:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690617.371572:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371599:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140b51 lrc: 0/0,0 mode: --/CR res: [0x200000bd3:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee66b expref: 74 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371624:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d000/0xb4bb873a19140b58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee66b expref: 73 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.371631:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:2.0:1779690617.371633:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1779690617.371645:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d000, rc 0) 00000100:00100000:2.0:1779690617.371690:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+73:112945:x1866137503852288:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 357us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.371696:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1244 00000100:00100000:3.0:1779690617.374351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690617.374430:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852416 00000100:00100000:1.0:1779690617.374439:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852416 00000100:00100000:1.0:1779690617.374632:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6540 00000100:00100000:1.0:1779690617.374644:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503852416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690617.374659:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690617.374678:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee672 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690617.374715:0:6582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690617.374731:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690617.374733:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690617.374741:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.374757:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690617.374774:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4402e00, rc 0) 00000100:00100000:1.0:1779690617.374849:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2391:x1866137503852416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 207us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.374858:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6540 00000100:00100000:3.0:1779690617.378519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.378760:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852672 00000100:00100000:0.0:1779690617.378769:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852672 00000100:00100000:0.0:1779690617.378854:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1245 00000100:00100000:0.0:1779690617.378865:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+73:112945:x1866137503852672:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.378966:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+73:112945:x1866137503852672:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.378974:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1245 00000100:00100000:3.0:1779690617.385490:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.385857:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852800 00000100:00100000:0.0:1779690617.385867:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852800 00000100:00100000:0.0:1779690617.385911:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1246 00000100:00100000:0.0:1779690617.385921:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+73:112945:x1866137503852800:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1779690617.392084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690617.392167:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503852928 00000100:00100000:2.0:1779690617.392176:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503852928 00000100:00100000:2.0:1779690617.392226:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1247 00000100:00100000:2.0:1779690617.392235:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+74:112312:x1866137503852928:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1779690617.392328:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+74:112312:x1866137503852928:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.392334:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1247 00000100:00100000:3.0:1779690617.394570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.395003:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503853184 00000100:00100000:0.0:1779690617.395010:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503853184 00000100:00100000:0.0:1779690617.395055:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 178 00000100:00100000:0.0:1779690617.395065:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+74:112312:x1866137503853184:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.395450:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+75:112312:x1866137503853184:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 386us (885us total) trans 12884902477 rc 0/0 00000100:00100000:0.0:1779690617.395458:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 178 00000100:00100000:0.0:1779690617.419620:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+74:112945:x1866137503852800:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 33692us (34130us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.419632:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1246 00000001:00080000:1.0:1779690617.420140:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902475 is committed 00000001:00080000:1.0:1779690617.420163:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902476 is committed 00000100:00100000:3.0:1779690617.425761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.425897:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503853312 00000100:00100000:0.0:1779690617.425906:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503853312 00000100:00100000:0.0:1779690617.425990:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6541 00000100:00100000:0.0:1779690617.426000:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503853312:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1779690617.426108:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503853312:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 109us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690617.426116:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6541 00000100:00100000:2.0:1779690617.432275:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690617.432377:0:57562:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503853568 00000100:00100000:0.0:1779690617.432387:0:57562:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503853568 00000100:00100000:0.0:1779690617.432492:0:57562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:0.0:1779690617.432502:0:57562:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+62:112945:x1866137503853568:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1779690617.433296:0:57562:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd3:0x32:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1779690617.433440:0:57562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x11:0x0].15, 64 off9200 00000004:00080000:0.0:1779690617.433451:0:57562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3345007645077ns, next at 3346007643122ns, rc = 0 00000001:00080000:0.0:1779690617.433466:0:57562:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 12884902478 00010000:00010000:0.0:1779690617.433512:0:57562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433528:0:57562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433540:0:57562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433558:0:57562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433565:0:57562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433571:0:57562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690617.433594:0:57562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690617.433709:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690617.433717:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.433726:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690617.433729:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690617.433738:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.433749:0:57562:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7a1272b-3551-4679-9948-3e2276470519+64:112945:x1866137503853568:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1243us (1476us total) trans 12884902479 rc 0/0 00010000:00010000:2.0:1779690617.433751:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x32:0x0].0x0 (ffff9e30bf50f200) 00010000:00010000:2.0:1779690617.433756:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1779690617.433761:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690617.433762:0:57562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 179 00010000:00010000:2.0:1779690617.433771:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140b66 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 57562 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1779690617.433771:0:57562:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1779690617.433792:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690617.433794:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690617.433797:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690617.738196:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690617.738276:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690617.738342:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:0.0:1779690617.738349:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690617.801018:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690617.801092:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801342:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492374400:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.801377:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801459:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492374912:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.801483:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801508:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1779690617.801515:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492374528:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.801539:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801578:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492375040:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.801619:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690617.801632:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492374656:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.801660:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374912 00000100:00100000:3.0:1779690617.801667:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374912 00000100:00100000:2.0:1779690617.801674:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690617.801704:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1779690617.801711:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690617.801735:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:2.0:1779690617.801740:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801747:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492374912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690617.801762:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374784:0@lo:400:kworker.0 00000100:00100000:2.0:1779690617.801789:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690617.801835:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492374912:12345-0@lo:400:kworker.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.801843:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:2.0:1779690617.801860:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374144 00000100:00100000:3.0:1779690617.801865:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374784 00000100:00100000:2.0:1779690617.801865:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374144 00000100:00100000:3.0:1779690617.801870:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374784 00000100:00100000:3.0:1779690617.801897:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:2.0:1779690617.801905:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374272 00000100:00100000:3.0:1779690617.801906:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492374784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690617.801910:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374272 00000100:00100000:2.0:1779690617.801929:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1779690617.801937:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492374144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690617.801948:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492374784:12345-0@lo:400:kworker.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.801955:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00002000:00000024:2.0:1779690617.801965:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690617.801978:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374528 00000100:00100000:3.0:1779690617.801982:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374528 00000100:00100000:2.0:1779690617.802001:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492374144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.802022:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1779690617.802023:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375040 00000100:00100000:3.0:1779690617.802027:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375040 00000100:00100000:2.0:1779690617.802044:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1779690617.802051:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374656 00000100:00100000:2.0:1779690617.802054:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492374272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690617.802055:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374656 00002000:00000024:2.0:1779690617.802078:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690617.802080:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1779690617.802089:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492374528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802132:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492374528:12345-0@lo:400:kworker.0 Request processed in 46us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690617.802140:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492374272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.802141:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1779690617.802151:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1779690617.802160:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1779690617.802167:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492375040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690617.802187:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1779690617.802198:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492374656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802205:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492375040:12345-0@lo:400:kworker.0 Request processed in 38us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690617.802211:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1779690617.802236:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690617.802242:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690617.802244:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492374656:12345-0@lo:400:kworker.0 Request processed in 49us (580us total) trans 0 rc 0/0 00000100:00080000:3.0:1779690617.802245:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690617.802254:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1779690617.802291:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492374528:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802307:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492375040:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802317:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492374912:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802352:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690617.802362:0:3320:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968359 gen 2 00000004:00080000:3.0:1779690617.802367:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e30b43f9880, transno 4294968359 00000100:00100000:3.0:1779690617.802390:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374784:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802401:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492374656:0@lo:400:kworker.0 00000100:00100000:3.0:1779690617.802412:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492374144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690617.802830:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492374400 00000100:00100000:1.0:1779690617.802835:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492374400 00000100:00100000:1.0:1779690617.802868:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1779690617.802875:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492374400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690617.802914:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492374400:12345-0@lo:400:kworker.0 Request processed in 40us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690617.802921:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1779690617.803066:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3088326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492374400:0@lo:400:kworker.0 00010000:00010000:2.0:1779690618.312932:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690619.337917:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1779690619.529630:0:74298:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 251: Coordinator request timeout ====== 02:30:18 (1779690618) 00000100:00100000:0.0:1779690619.574052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690619.574925:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503853696 00000100:00100000:3.0:1779690619.574943:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503853696 00000100:00100000:3.0:1779690619.575040:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1248 00000100:00100000:3.0:1779690619.575057:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:113127:x1866137503853696:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690619.575086:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690619.575113:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee679 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1779690619.575397:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690619.575420:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.575439:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.575456:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.575477:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.575485:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.575493:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577477:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577497:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577505:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577512:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4b200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690619.577518:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577554:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577587:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690619.577591:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.577598:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577605:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577632:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577639:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577645:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577651:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ae00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690619.577654:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577660:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577668:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (ffff9e2f905ad300) 00010000:00010000:3.0:1779690619.577670:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.577674:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577708:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577775:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140b6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee679 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577787:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690619.577790:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.577794:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee679 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.577821:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4aa00, rc 0) 00000100:00100000:3.0:1779690619.577916:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:113127:x1866137503853696:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2863us (3871us total) trans 0 rc 301/301 00000100:00100000:3.0:1779690619.577926:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1248 00000100:00100000:3.0:1779690619.583389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690619.583449:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503853952 00000100:00100000:0.0:1779690619.583473:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503853952 00000100:00100000:0.0:1779690619.583541:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1249 00000100:00100000:0.0:1779690619.583552:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:113127:x1866137503853952:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1779690619.583604:0:57559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690619.583629:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85870200/0xb4bb873a19140729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee51b expref: 65 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.583648:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:0.0:1779690619.583653:0:57559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690619.584106:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.584122:0:57559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 63 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.584132:0:57559:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.584163:0:57559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 63 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.584178:0:57559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 63 pid: 64445 timeout: 3447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690619.584193:0:57559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492375168:192.168.203.5@tcp:104: 00000100:00100000:0.0:1779690619.584288:0:57559:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f8b8450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1779690619.586853:0:57559:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:57559:1866137492375168:192.168.203.5@tcp:104: 00000100:00100000:2.0:1779690619.586861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:0.0:1779690619.586885:0:57559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690619.587388:0:17231:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854080 00000100:00100000:3.0:1779690619.587403:0:17231:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854080 00000100:00080000:0.0:1779690619.587467:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690619.587476:0:17231:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 64 pid: 64445 timeout: 3447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690619.587523:0:17231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3351 00000100:00100000:3.0:1779690619.587548:0:17231:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+64:2392:x1866137503854080:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690619.587568:0:17231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1779690619.587575:0:17231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 64 pid: 64445 timeout: 3447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.587606:0:17231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 64 pid: 64445 timeout: 3447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.588918:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f85871000/0xb4bb873a191405d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee4b9 expref: 64 pid: 64445 timeout: 3447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.588947:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:3.0:1779690619.588954:0:17231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.588966:0:17231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.588975:0:17231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.589034:0:17231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690619.589123:0:17231:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503854080:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1577us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690619.589134:0:17231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3351 00010000:00010000:0.0:1779690619.589325:0:57559:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.589340:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.589367:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.589381:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.589391:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690619.592384:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x99:0x0]: returning size 512 00010000:00010000:0.0:1779690619.592402:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592549:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592556:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592562:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690619.592566:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592575:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592599:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2f90442900) 00010000:00010000:0.0:1779690619.592601:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690619.592607:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.592612:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690619.592633:0:57559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b076bb96 reply state 00000000025bde44 transno 12884902480 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690619.592642:0:57559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1779690619.592887:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+66:113127:x1866137503853952:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 9333us (9505us total) trans 12884902480 rc 0/0 00000100:00100000:0.0:1779690619.592896:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1249 00010000:00010000:3.0:1779690619.599565:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599582:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599590:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599608:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690619.599613:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599621:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599637:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (ffff9e30bf50f700) 00010000:00010000:3.0:1779690619.599641:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.599645:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.599652:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140b89 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690619.635676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690619.635876:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854208 00000100:00100000:0.0:1779690619.635886:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854208 00000100:00100000:0.0:1779690619.635945:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1250 00000100:00100000:0.0:1779690619.635955:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:113137:x1866137503854208:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690619.635979:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690619.637050:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee680 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637124:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637138:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637161:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690619.637232:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690619.637236:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690619.637260:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637286:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee680 expref: 65 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637302:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee680 expref: 64 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.637311:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f600) 00010000:00010000:0.0:1779690619.637313:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690619.637317:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb9200, rc 0) 00000100:00100000:0.0:1779690619.637388:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:113137:x1866137503854208:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1434us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690619.637397:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1250 00000100:00100000:3.0:1779690619.639988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690619.640194:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854464 00000100:00100000:0.0:1779690619.640203:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854464 00000100:00100000:0.0:1779690619.640288:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1251 00000100:00100000:0.0:1779690619.640298:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+64:113137:x1866137503854464:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:0.0:1779690619.640352:0:57560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1779690619.640372:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140b97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee680 expref: 64 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.640400:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f600) 00010000:00010000:0.0:1779690619.640410:0:57560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1779690619.640552:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:113137:x1866137503854464:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 255us (580us total) trans 0 rc -17/-17 00000100:00100000:0.0:1779690619.640558:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1251 00000100:00100000:3.0:1779690619.645060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690619.645225:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854592 00000100:00100000:0.0:1779690619.645233:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854592 00000100:00100000:0.0:1779690619.645282:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1252 00000100:00100000:0.0:1779690619.645291:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:113137:x1866137503854592:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:0.0:1779690619.645311:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690619.645331:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee687 expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645392:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ba5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645406:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645417:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1779690619.645478:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1779690619.645482:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:0.0:1779690619.645507:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645539:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140b9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee687 expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645573:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8c00/0xb4bb873a19140ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee687 expref: 64 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.645582:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:0.0:1779690619.645585:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1779690619.645589:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f82bb8c00, rc 0) 00000100:00100000:0.0:1779690619.645650:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+64:113137:x1866137503854592:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 358us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690619.645657:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1252 00000100:00100000:0.0:1779690619.648215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690619.648327:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854720 00000100:00100000:2.0:1779690619.648336:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854720 00000100:00100000:2.0:1779690619.648391:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1253 00000100:00100000:2.0:1779690619.648402:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+64:113137:x1866137503854720:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1779690619.648421:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690619.648440:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a19140bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee68e expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648494:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648508:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648519:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648560:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648568:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648575:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648689:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648698:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648705:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690619.648740:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x99:0x0]: returning size 512 00000004:00200000:2.0:1779690619.648743:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690619.648763:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648772:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648778:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648784:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.648799:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2ce00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690619.649118:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649129:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649141:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:2.0:1779690619.649144:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690619.649149:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649155:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2ce00/0xb4bb873a19140bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649170:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649176:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649181:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649186:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2c400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690619.649188:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649194:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649212:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (ffff9e2f90226d00) 00010000:00010000:2.0:1779690619.649215:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690619.649218:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649223:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c400/0xb4bb873a19140bba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649252:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d600/0xb4bb873a19140bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee68e expref: 66 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649265:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee68e expref: 65 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.649272:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:2.0:1779690619.649275:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690619.649277:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2d800, rc 0) 00000100:00100000:2.0:1779690619.649323:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+65:113137:x1866137503854720:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 924us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690619.649330:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1253 00000100:00100000:3.0:1779690619.663029:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690619.663196:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503854848 00000100:00100000:1.0:1779690619.663206:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503854848 00000100:00100000:1.0:1779690619.663265:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1254 00000100:00100000:1.0:1779690619.663275:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+65:113138:x1866137503854848:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1779690619.663296:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690619.663317:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402400/0xb4bb873a19140bc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee695 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663384:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663398:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663409:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663423:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663429:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663450:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663523:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663541:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663557:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663563:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690619.663567:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663575:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663586:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690619.663589:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690619.663750:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663759:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140bcf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663773:0:57560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663780:0:57560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663792:0:57560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663799:0:57560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4402a00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690619.663802:0:57560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663869:0:57560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663878:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x63615bf2 (ffff9e2f90442a00) 00010000:00010000:1.0:1779690619.663880:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690619.663883:0:57560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663889:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140bd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663925:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402400/0xb4bb873a19140bc8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee695 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663937:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:1.0:1779690619.663940:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690619.663945:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402400/0xb4bb873a19140bc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee695 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690619.663957:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4402400, rc 0) 00000100:00100000:1.0:1779690619.664061:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+65:113138:x1866137503854848:12345-192.168.203.5@tcp:101:rm.0 Request processed in 787us (1041us total) trans 0 rc 301/301 00000100:00100000:1.0:1779690619.664077:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1254 00000100:00100000:3.0:1779690619.679402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690619.680872:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855104 00000100:00100000:0.0:1779690619.680883:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855104 00000100:00100000:0.0:1779690619.680946:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1255 00000100:00100000:0.0:1779690619.680958:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+65:113139:x1866137503855104:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1779690619.680977:0:64445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1779690619.680980:0:64445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1779690619.681004:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d800/0xb4bb873a19140bc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee68e expref: 65 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681022:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f90226500) 00010000:00010000:0.0:1779690619.681036:0:64445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1779690619.681050:0:64445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140bdd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee69c expref: -99 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681267:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681284:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681294:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681307:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681313:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.681319:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1779690619.682001:0:64445:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f6:0x0], index 1: 0 00010000:00010000:0.0:1779690619.682402:0:64445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140bf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682414:0:64445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682611:0:64445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682647:0:64445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682654:0:64445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682661:0:64445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682673:0:64445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb9200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690619.682677:0:64445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682684:0:64445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682694:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e30bf50f600) 00010000:00010000:0.0:1779690619.682696:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1779690619.682701:0:64445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682707:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb9200/0xb4bb873a19140be4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1779690619.682717:0:64445:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002e274172 reply state 000000004dd49694 transno 12884902481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1779690619.682726:0:64445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1779690619.682756:0:64445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8400/0xb4bb873a19140bdd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee69c expref: 67 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682774:0:64445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f8b283800/0xb4bb873a19140bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee69c expref: 66 pid: 64445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690619.682781:0:64445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x34:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:0.0:1779690619.682783:0:64445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1779690619.682785:0:64445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f8b283800, rc 0) 00000100:00100000:0.0:1779690619.682862:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+67:113139:x1866137503855104:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1907us (3470us total) trans 12884902481 rc 0/0 00000100:00100000:0.0:1779690619.682877:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1255 00010000:00010000:2.0:1779690619.684429:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684445:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684459:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684475:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f82bb8e00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690619.684477:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684482:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684493:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x63615bf2 (ffff9e30bf50f300) 00010000:00010000:2.0:1779690619.684495:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690619.684498:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690619.684502:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f82bb8e00/0xb4bb873a19140beb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690619.685963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690619.686195:0:57563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855360 00000100:00100000:2.0:1779690619.686205:0:57563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855360 00000100:00100000:2.0:1779690619.686260:0:57563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:2.0:1779690619.686271:0:57563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+66:113139:x1866137503855360:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:2.0:1779690619.686600:0:57563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7a1272b-3551-4679-9948-3e2276470519+67:113139:x1866137503855360:12345-192.168.203.5@tcp:35:dd.0 Request processed in 330us (644us total) trans 12884902482 rc 0/0 00000100:00100000:2.0:1779690619.686609:0:57563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:3.0:1779690619.705283:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690619.708087:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855488 00000100:00100000:2.0:1779690619.708100:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855488 00000100:00100000:3.0:1779690619.708382:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1256 00000100:00100000:3.0:1779690619.708393:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+67:113140:x1866137503855488:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1779690619.708417:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1779690619.708436:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6a3 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708518:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708544:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708555:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708569:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708576:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708582:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708762:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140c15 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708930:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140c15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.708939:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140c15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1779690619.708975:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x99:0x0]: returning size 512 00000004:00200000:3.0:1779690619.709040:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1779690619.709066:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140c15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709089:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709096:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709103:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709108:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4ae00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690619.709112:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709119:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709129:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:3.0:1779690619.709132:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.709137:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709142:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4ae00/0xb4bb873a19140c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709152:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709157:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709163:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709174:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4b200 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:3.0:1779690619.709177:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709183:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709191:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (ffff9e2f905ad300) 00010000:00010000:3.0:1779690619.709194:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1779690619.709196:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709202:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b200/0xb4bb873a19140c0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709291:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4aa00/0xb4bb873a19140c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6a3 expref: 69 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709305:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4b000/0xb4bb873a19140c15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6a3 expref: 68 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690619.709313:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f905ad100) 00010000:00010000:3.0:1779690619.709315:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1779690619.709318:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3084e4b000, rc 0) 00000100:00100000:3.0:1779690619.709439:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+68:113140:x1866137503855488:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1047us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690619.709448:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1256 00000100:00100000:2.0:1779690620.353211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690620.353406:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856128 00000100:00100000:2.0:1779690620.353415:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856128 00000100:00100000:2.0:1779690620.353457:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855744 00000100:00100000:2.0:1779690620.353460:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855744 00000100:00100000:2.0:1779690620.353480:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 326 00000100:00100000:2.0:1779690620.353489:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2389:x1866137503856128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353557:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855872 00000100:00100000:3.0:1779690620.353569:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855872 00000100:00100000:2.0:1779690620.353581:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+65:2389:x1866137503856128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690620.353589:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 326 00000100:00100000:2.0:1779690620.353609:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 327 00000100:00100000:3.0:1779690620.353614:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856384 00000100:00100000:2.0:1779690620.353618:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+68:2389:x1866137503855744:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353619:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856384 00000100:00100000:3.0:1779690620.353645:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856000 00000100:00100000:3.0:1779690620.353649:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856000 00000100:00100000:2.0:1779690620.353650:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+68:2389:x1866137503855744:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690620.353658:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 327 00000100:00100000:3.0:1779690620.353673:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856256 00000100:00100000:3.0:1779690620.353676:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856256 00000100:00100000:3.0:1779690620.353699:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3013 00000100:00100000:3.0:1779690620.353707:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503855872:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353738:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+10:2389:x1866137503855872:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690620.353744:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3013 00000100:00100000:3.0:1779690620.353759:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3014 00000100:00100000:3.0:1779690620.353764:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+11:2389:x1866137503856384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353787:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+11:2389:x1866137503856384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690620.353792:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3014 00000100:00100000:3.0:1779690620.353802:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3015 00000100:00100000:3.0:1779690620.353841:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503856000:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353864:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503856000:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690620.353869:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3015 00000100:00100000:3.0:1779690620.353881:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3016 00000100:00100000:3.0:1779690620.353887:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503856256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690620.353906:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503856256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690620.353919:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3016 00000100:00100000:1.0:1779690620.353965:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503855616 00000100:00100000:1.0:1779690620.353970:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503855616 00000100:00100000:1.0:1779690620.353999:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:1.0:1779690620.354006:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503855616:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690620.354031:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503855616:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690620.354037:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00080000:3.0:1779690620.359667:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690620.359675:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690620.363556:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1779690621.386324:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690622.409002:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1779690622.446107:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902481 is committed 00000001:00080000:1.0:1779690622.446122:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902480 is committed 00000004:00080000:1.0:1779690622.446128:0:57578:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000001:00080000:1.0:1779690622.446161:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902482 is committed 00000100:00100000:1.0:1779690622.446223:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690622.446242:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492375296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1779690622.446302:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.446367:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375296 00000100:00100000:1.0:1779690622.446374:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375296 00000100:00100000:1.0:1779690622.446422:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6542 00000100:00100000:1.0:1779690622.446431:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492375296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1779690622.446456:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:502 count 1 00010000:00010000:1.0:1779690622.446492:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690622.446521:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 9 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690622.446542:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690622.446544:0:6581:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690622.446548:0:6581:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690622.446573:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 9 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690622.446587:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 9 pid: 6582 timeout: 3450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690622.446599:0:6581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492375424:192.168.203.5@tcp:104: 00000100:00100000:1.0:1779690622.446653:0:6581:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f97138c00 going to sleep for 11 seconds 00000100:00080000:3.0:1779690622.446686:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690622.448836:0:6581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1866137492375424:192.168.203.5@tcp:104: 00010000:00010000:1.0:1779690622.448863:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1779690622.450107:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690622.450875:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856512 00000100:00100000:3.0:1779690622.450884:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856512 00010000:00010000:3.0:1779690622.450929:0:5780:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 3450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1779690622.450964:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3352 00000100:00100000:3.0:1779690622.450978:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b1b80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+10:2392:x1866137503856512:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690622.450991:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1779690622.450994:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690622.450997:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 3450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690622.451010:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 3450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690622.451034:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac44338/0xb4bb873a19140b5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee672 expref: 10 pid: 6582 timeout: 3450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690622.451048:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690622.451050:0:5780:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1779690622.451055:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690622.451078:0:5780:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690622.451100:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690622.451148:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b1b80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503856512:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 171us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690622.451155:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3352 00010000:00010000:0.0:1779690622.451224:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690622.451234:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690622.451243:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690622.451250:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690622.451286:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1779690622.451635:0:5782:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1779690622.451642:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690622.451650:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4402200 already unused, calling callback (ffffffffc14756f0) 00010000:00010000:2.0:1779690622.451653:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690622.451661:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690622.451680:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690622.451686:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001868067a/0xb4bb873a19140c1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690622.451702:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690622.451704:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1779690622.451705:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690622.452249:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492375296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5817us (5945us total) trans 4294968360 rc 0/0 00000100:00100000:0.0:1779690622.452259:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6542 00000004:00080000:2.0:1779690622.452344:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2f81a20000/2, rc 0, transno 4294968360 00000100:00100000:2.0:1779690622.452351:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492375296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1779690622.921036:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492375552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690622.921102:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.921174:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375552 00000100:00100000:1.0:1779690622.921182:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375552 00000100:00100000:1.0:1779690622.921228:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1779690622.921237:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492375552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690622.921275:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690622.921317:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492375552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.921325:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1779690622.921369:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492375552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690622.921724:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492375808:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.921755:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.921775:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1779690622.921781:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492375680:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.921828:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.921854:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492376192:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.921876:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.921903:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375808 00000100:00100000:1.0:1779690622.921908:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375808 00000100:00100000:1.0:1779690622.921944:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376192 00000100:00100000:1.0:1779690622.921947:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376192 00000100:00100000:1.0:1779690622.921965:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1779690622.921972:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492375808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922006:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492375808:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.922014:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1779690622.922026:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1779690622.922032:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492376192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922058:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492376192:12345-0@lo:400:kworker.0 Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.922075:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1779690622.922095:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375680 00000100:00100000:1.0:1779690622.922099:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375680 00000100:00100000:1.0:1779690622.922122:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1779690622.922129:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922158:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492375680:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.922164:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1779690622.922202:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492375936:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922223:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.922241:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1779690622.922246:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492376064:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922268:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690622.922302:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492375936 00000100:00100000:1.0:1779690622.922305:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492375936 00000100:00100000:1.0:1779690622.922329:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1779690622.922335:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492375936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922366:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492375936:12345-0@lo:400:kworker.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.922372:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1779690622.922388:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376064 00000100:00100000:1.0:1779690622.922391:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376064 00000100:00100000:1.0:1779690622.922423:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1779690622.922428:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492376064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922458:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492376064:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690622.922473:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1779690622.922518:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492376064:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922528:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492375936:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922550:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492375680:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922558:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492376192:0@lo:400:kworker.0 00000100:00100000:1.0:1779690622.922567:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492375808:0@lo:400:kworker.0 00000100:00080000:0.0:1779690622.923013:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690622.923019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690622.923187:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1779690622.923198:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492376320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690622.923233:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690622.923264:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376320 00000100:00100000:2.0:1779690622.923268:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376320 00000100:00100000:2.0:1779690622.923295:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1779690622.923302:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492376320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690622.923329:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 620953600 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690622.923367:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492376320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690622.923374:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1779690622.923408:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492376320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1779690623.433149:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1779690623.471621:0:6605:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968360 is committed 00010000:00010000:2.0:1779690624.457915:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690624.905016:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690624.905038:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1779690624.905110:0:57595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905121:0:57595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905129:0:57595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905135:0:57595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3084e4bc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690624.905139:0:57595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905146:0:57595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905175:0:57595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2e:0x0].0x0 (ffff9e2f905ada00) 00010000:00010000:2.0:1779690624.905179:0:57595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1779690624.905184:0:57595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690624.905190:0:57595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3084e4bc00/0xb4bb873a19140a0f lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1779690624.905337:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:2.0:1779690624.905344:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690624.905417:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690624.905420:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690624.905446:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 16 00000040:00080000:2.0:1779690624.905451:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690624.958868:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690624.958985:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856768 00000100:00100000:1.0:1779690624.958995:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856768 00000100:00080000:0.0:1779690624.959047:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690624.959074:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1257 00000100:00100000:1.0:1779690624.959085:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:113243:x1866137503856768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1779690624.959104:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690624.959124:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6aa expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959191:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959203:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959213:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959260:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959283:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959290:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959707:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959717:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959725:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690624.959734:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1779690624.959929:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959937:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959943:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959949:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4402c00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690624.959952:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959960:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959982:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2f883cb200) 00010000:00010000:1.0:1779690624.959985:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690624.959990:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.959996:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402c00/0xb4bb873a19140c2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960007:0:57559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960012:0:57559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960017:0:57559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960022:0:57559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4403400 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:1.0:1779690624.960025:0:57559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960030:0:57559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960036:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2f90442300) 00010000:00010000:1.0:1779690624.960038:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690624.960040:0:57559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960045:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403400/0xb4bb873a19140c31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960372:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6aa expref: 66 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960387:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6aa expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.960394:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690624.960396:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1779690624.960398:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4402a00, rc 0) 00000100:00100000:1.0:1779690624.960463:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+65:113243:x1866137503856768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1381us (1603us total) trans 12884902483 rc 0/0 00000100:00100000:1.0:1779690624.960480:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1257 00000100:00100000:3.0:1779690624.966417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690624.966856:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503856896 00000100:00100000:1.0:1779690624.966871:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503856896 00000100:00100000:1.0:1779690624.966957:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1258 00000100:00100000:1.0:1779690624.966969:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+65:113243:x1866137503856896:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1779690624.967101:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+65:113243:x1866137503856896:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 134us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690624.967110:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1258 00000100:00100000:3.0:1779690624.967428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690624.967826:0:7464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857024 00000100:00100000:1.0:1779690624.967833:0:7464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857024 00000100:00100000:1.0:1779690624.967880:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18696 00000100:00100000:1.0:1779690624.967888:0:7464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+65:2392:x1866137503857024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1779690624.967901:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1779690624.968024:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6aa expref: 65 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690624.968063:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e308bf54700) 00010000:00010000:1.0:1779690624.968070:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1779690624.968109:0:7464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7a1272b-3551-4679-9948-3e2276470519+64:2392:x1866137503857024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 222us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690624.968116:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18696 00000100:00100000:3.0:1779690625.109444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690625.110457:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857152 00000100:00100000:1.0:1779690625.110479:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857152 00000100:00100000:1.0:1779690625.110615:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1259 00000100:00100000:1.0:1779690625.110626:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+64:113252:x1866137503857152:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690625.110653:0:57560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690625.110679:0:57560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6b1 expref: -99 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.110774:0:57560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.110792:0:57560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.110826:0:57560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1779690625.111074:0:57560:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1779690625.111079:0:57560:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 115 stripe count 1 MDT count 1 00000004:00010000:1.0:1779690625.111163:0:57560:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.111193:0:57560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402a00/0xb4bb873a19140c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6b1 expref: 66 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.111220:0:57560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4403e00/0xb4bb873a19140c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6b1 expref: 65 pid: 57560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.111229:0:57560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:1.0:1779690625.111233:0:57560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1779690625.111238:0:57560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4403e00, rc 0) 00000100:00100000:1.0:1779690625.111317:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+65:113252:x1866137503857152:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 693us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690625.111325:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1259 00000100:00080000:0.0:1779690625.112064:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690625.114871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690625.114976:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857280 00000100:00100000:2.0:1779690625.115001:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857280 00000100:00100000:2.0:1779690625.115076:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1260 00000100:00100000:2.0:1779690625.115087:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+65:113252:x1866137503857280:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690625.115114:0:57585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690625.115139:0:57585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6b8 expref: -99 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115220:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115238:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115252:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115270:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115278:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115284:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115777:0:57585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a19140c69 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115788:0:57585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a19140c69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.115796:0:57585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a19140c69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690625.116703:0:57585:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x99:0x0]: returning size 7680 00000004:00200000:2.0:1779690625.116709:0:57585:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690625.116795:0:57585:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a19140c69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116881:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116889:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116896:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116901:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690625.116906:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116913:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116929:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e30bf50f900) 00010000:00010000:2.0:1779690625.116931:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690625.116936:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116942:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116957:0:57585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116974:0:57585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116979:0:57585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116984:0:57585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690625.116986:0:57585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.116992:0:57585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.117000:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (ffff9e2f90226a00) 00010000:00010000:2.0:1779690625.117002:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690625.117005:0:57585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.117010:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.117154:0:57585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6b8 expref: 67 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.117172:0:57585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2c600/0xb4bb873a19140c69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6b8 expref: 66 pid: 57585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.117180:0:57585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f905ad100) 00010000:00010000:2.0:1779690625.117182:0:57585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1779690625.117191:0:57585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2c600, rc 0) 00000100:00100000:2.0:1779690625.117319:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+66:113252:x1866137503857280:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2233us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690625.117329:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1260 00000100:00100000:3.0:1779690625.126396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690625.126570:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857408 00000100:00100000:2.0:1779690625.126584:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857408 00000100:00100000:2.0:1779690625.126657:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1261 00000100:00100000:2.0:1779690625.126669:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+66:113252:x1866137503857408:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690625.126696:0:57561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690625.126721:0:57561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c70 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6bf expref: -99 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126839:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126858:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126872:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126889:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126896:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.126903:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127359:0:57561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127376:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127383:0:57561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690625.127424:0:57561:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0x34:0x0]: returning size 0 00000004:00200000:2.0:1779690625.127429:0:57561:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690625.127449:0:57561:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127460:0:57561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127480:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127487:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127494:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127499:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2da00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690625.127504:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127512:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127525:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f905ad100) 00010000:00010000:2.0:1779690625.127534:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690625.127540:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127546:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2da00/0xb4bb873a19140c77 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127562:0:57561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127568:0:57561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127573:0:57561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127579:0:57561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2f89c2cc00 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:2.0:1779690625.127581:0:57561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127587:0:57561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127594:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x63615bf2 (ffff9e2f90226a00) 00010000:00010000:2.0:1779690625.127596:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1779690625.127599:0:57561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127604:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c7e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127637:0:57561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c70 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6bf expref: 68 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127659:0:57561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2de00/0xb4bb873a19140c85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6bf expref: 67 pid: 57561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.127667:0:57561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x34:0x0].0x0 (ffff9e30bf50f700) 00010000:00010000:2.0:1779690625.127669:0:57561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1779690625.127672:0:57561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2de00, rc 0) 00000100:00100000:2.0:1779690625.127755:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+67:113252:x1866137503857408:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1088us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690625.127764:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1261 00000100:00100000:3.0:1779690625.137665:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690625.137852:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857536 00000100:00100000:1.0:1779690625.137866:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857536 00000100:00100000:1.0:1779690625.137960:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6543 00000100:00100000:1.0:1779690625.137972:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+11:2391:x1866137503857536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1779690625.137996:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1779690625.138024:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a51d0e56/0xb4bb873a19140c8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6c6 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1779690625.138064:0:6582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1779690625.138093:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690625.138096:0:6582:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1779690625.138106:0:6582:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a51d0e56/0xb4bb873a19140c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6c6 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.138127:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a51d0e56/0xb4bb873a19140c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6c6 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1779690625.138167:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e30b4402a00, rc 0) 00000100:00100000:1.0:1779690625.138255:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503857536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 286us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690625.138263:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6543 00000100:00080000:0.0:1779690625.140958:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690625.148330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690625.148496:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857664 00000100:00100000:2.0:1779690625.148510:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857664 00000100:00100000:2.0:1779690625.148590:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1262 00000100:00100000:2.0:1779690625.148602:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+67:113252:x1866137503857664:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1779690625.148631:0:57559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1779690625.148659:0:57559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5ac8fd750bee6cd expref: -99 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.148761:0:57559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c9a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.148780:0:57559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.148793:0:57559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1779690625.149101:0:57559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x99:0x0]: returning size 7680 00000004:00200000:2.0:1779690625.149114:0:57559:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1779690625.149224:0:57559:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 57559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.149259:0:57559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2d400/0xb4bb873a19140c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6cd expref: 69 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.149282:0:57559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2f89c2cc00/0xb4bb873a19140c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee6cd expref: 68 pid: 57559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1779690625.149294:0:57559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x99:0x0].0x0 (ffff9e2f905ad100) 00010000:00010000:2.0:1779690625.149298:0:57559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1779690625.149303:0:57559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2f89c2cc00, rc 0) 00000100:00100000:2.0:1779690625.149386:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:113252:x1866137503857664:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 787us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690625.149395:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1262 00000100:00100000:1.0:1779690625.156272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690625.156715:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503857920 00000100:00100000:2.0:1779690625.156729:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503857920 00000100:00100000:2.0:1779690625.156825:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1263 00000100:00100000:2.0:1779690625.156837:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:113252:x1866137503857920:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1779690625.157309:0:57585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x15:0x0].54, 136 off15536 00000100:00100000:2.0:1779690625.157433:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:113252:x1866137503857920:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 597us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690625.157444:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1263 00000100:00100000:3.0:1779690625.472115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690625.472203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690625.472234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690625.472260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690625.472284:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858304 00000100:00100000:3.0:1779690625.472293:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858304 00000100:00100000:3.0:1779690625.472343:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858176 00000100:00100000:3.0:1779690625.472345:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858176 00000100:00100000:3.0:1779690625.472360:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858432 00000100:00100000:3.0:1779690625.472362:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858432 00000100:00100000:3.0:1779690625.472384:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3018 00000100:00100000:3.0:1779690625.472403:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503858304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690625.472486:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503858304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 84us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690625.472493:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3018 00000100:00100000:3.0:1779690625.472512:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3019 00000100:00100000:3.0:1779690625.472518:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503858176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690625.472546:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503858176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690625.472551:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3019 00000100:00100000:3.0:1779690625.472561:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3020 00000100:00100000:3.0:1779690625.472566:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503858432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690625.472599:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503858432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690625.472605:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3020 00000100:00080000:0.0:1779690625.472791:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690625.472795:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690625.478059:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858048 00000100:00100000:1.0:1779690625.478073:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858048 00000100:00100000:1.0:1779690625.478154:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 221 00000100:00100000:1.0:1779690625.478165:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503858048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690625.478245:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503858048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (6138us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690625.478253:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 221 00010000:00010000:3.0:1779690625.485111:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690625.817734:0:74736:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690625.817742:0:74736:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690625.817935:0:74736:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 17 00000040:00080000:1.0:1779690625.817941:0:74736:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690625.932102:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690625.932108:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690625.932150:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 17 00000040:00080000:1.0:1779690625.932158:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690625.932493:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492376448:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1779690625.933572:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1779690625.947770:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492376448:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690626.499729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690626.504998:0:17753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858560 00000100:00100000:2.0:1779690626.505011:0:17753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858560 00002000:00100000:2.0:1779690626.505153:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1f2:0x0] (1044480->1048575) req@ffff9e2f8a342300 x1866137503858560/t0(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:107/0 lens 4584/0 e 0 to 0 dl 1779690637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690626.505182:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8a342300 with x1866137503858560 ext(1044480->1048575) 00002000:00010000:2.0:1779690626.505187:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8a342300 00000100:00100000:2.0:1779690626.505221:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2094 00000100:00100000:2.0:1779690626.505230:0:17753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503858560:12345-192.168.203.5@tcp:4:cmp.0 00000100:00100000:2.0:1779690626.505697:0:17753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e775ff0e-5641-488a-99d7-1331a4992115+14:2389:x1866137503858560:12345-192.168.203.5@tcp:4:cmp.0 Request processed in 467us (5975us total) trans 4294968464 rc 0/0 00000100:00100000:2.0:1779690626.505705:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2094 00002000:00100000:2.0:1779690626.505712:0:17753:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1f2:0x0] (1044480->1048575) req@ffff9e2f8a342300 x1866137503858560/t4294968464(0) o4->e775ff0e-5641-488a-99d7-1331a4992115@192.168.203.5@tcp:107/0 lens 4584/448 e 0 to 0 dl 1779690637 ref 1 fl Complete:/600/0 rc 0/0 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1779690626.505719:0:17753:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2f8a342300 with x1866137503858560 ext(1044480->1048575) 00002000:00010000:2.0:1779690626.505723:0:17753:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2f8a342300 00010000:00010000:1.0:1779690626.505828:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690626.958893:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690626.958911:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690626.958961:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 17 00000040:00080000:0.0:1779690626.958967:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690627.364679:0:74787:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690627.364688:0:74787:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690627.364785:0:74787:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 17 00000040:00080000:0.0:1779690627.364791:0:74787:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690627.529963:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1779690627.566355:0:7477:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968464 is committed 00000001:00080000:2.0:1779690627.570714:0:57578:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902483 is committed 00000040:00080000:0.0:1779690627.977061:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690627.977069:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1779690627.977254:0:57595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977266:0:57595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977272:0:57595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977278:0:57595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e30b4402600 already unused, calling callback (ffffffffc1ec64f0) 00010000:00010000:0.0:1779690627.977282:0:57595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977289:0:57595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977305:0:57595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0x2f:0x0].0x0 (ffff9e2f90442c00) 00010000:00010000:0.0:1779690627.977308:0:57595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1779690627.977313:0:57595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1779690627.977319:0:57595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e30b4402600/0xb4bb873a19140a71 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 57561 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1779690627.977440:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 17 00000040:00080000:0.0:1779690627.977456:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690627.977675:0:57595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492376576:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1779690627.977898:0:57595:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e2f829b9540 going to sleep for 11 seconds 00000100:00100000:3.0:1779690627.984146:0:57595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:57595:1866137492376576:192.168.203.5@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1779690627.985865:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690627.985872:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690627.986529:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 17 00000040:00080000:3.0:1779690627.986538:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690628.041000:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f89d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492377088:0@lo:400:kworker.0 00000100:00100000:2.0:1779690628.041035:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492376960:0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041047:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492376704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690628.041073:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690628.041084:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690628.041100:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690628.041141:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492377472:0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041142:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492377216:0@lo:400:kworker.0 00000100:00100000:1.0:1779690628.041153:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492376832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690628.041186:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690628.041187:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690628.041199:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690628.041223:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690628.041227:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492377344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690628.041234:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492377600:0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041250:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377088 00000100:00100000:2.0:1779690628.041262:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690628.041289:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376960 00000100:00100000:2.0:1779690628.041294:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376960 00000100:00100000:2.0:1779690628.041353:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1779690628.041361:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492376960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.041397:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377216 00000100:00100000:3.0:1779690628.041403:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377216 00000100:00100000:2.0:1779690628.041411:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492376960:12345-0@lo:400:kworker.0 Request processed in 50us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690628.041420:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1779690628.041434:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377088 00000100:00100000:3.0:1779690628.041452:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377600 00000100:00100000:3.0:1779690628.041456:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377600 00000100:00100000:2.0:1779690628.041478:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376704 00000100:00100000:2.0:1779690628.041483:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376704 00000100:00100000:0.0:1779690628.041490:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1779690628.041508:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690628.041513:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492377216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690628.041515:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492376832 00000100:00100000:2.0:1779690628.041520:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492376832 00000100:00100000:2.0:1779690628.041544:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1779690628.041555:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1779690628.041564:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492377216:12345-0@lo:400:kworker.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690628.041567:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492376832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690628.041578:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00002000:00000024:1.0:1779690628.041589:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3757047808 00000100:00100000:0.0:1779690628.041598:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1779690628.041606:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492377088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041646:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492377088:12345-0@lo:400:kworker.0 Request processed in 41us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690628.041652:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1779690628.041664:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1779690628.041670:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492377600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041695:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492377600:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690628.041711:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1779690628.041891:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377472 00000100:00100000:3.0:1779690628.041896:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377472 00000100:00100000:3.0:1779690628.041919:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377344 00000100:00100000:3.0:1779690628.041922:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377344 00000100:00080000:0.0:1779690628.041931:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690628.041937:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690628.041941:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00080000:0.0:1779690628.041942:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690628.041949:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492377472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690628.041977:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f89d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492377088:0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.041988:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492377472:12345-0@lo:400:kworker.0 Request processed in 39us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690628.041994:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1779690628.042010:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022 00000100:00100000:0.0:1779690628.042017:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492377216:0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.042019:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492377344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.042061:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492377344:12345-0@lo:400:kworker.0 Request processed in 45us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690628.042068:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022 00000100:00100000:0.0:1779690628.042084:0:3321:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968360 gen 2 00000004:00080000:0.0:1779690628.042091:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2f81a20000, transno 4294968360 00000100:00100000:0.0:1779690628.042103:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492377344:0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.042129:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492377600:0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.042140:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492376960:0@lo:400:kworker.0 00000100:00100000:3.0:1779690628.042148:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492377472:0@lo:400:kworker.0 00000100:00100000:1.0:1779690628.042708:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492376832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1144us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690628.042715:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1779690628.042752:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492376832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690628.043736:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492376704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690628.043779:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690628.043860:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492376704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2309us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690628.043867:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1779690628.044029:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492376704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1779690628.553098:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690629.001075:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690629.001082:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690629.001462:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 16 00000040:00080000:3.0:1779690629.001470:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690629.001580:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690629.001584:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690629.002596:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 16 00000040:00080000:3.0:1779690629.002606:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690629.007665:0:74841:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690629.007675:0:74841:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690629.007778:0:74841:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 16 00000040:00080000:2.0:1779690629.007786:0:74841:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690629.577401:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690630.025060:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690630.025069:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690630.025104:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 16 00000040:00080000:3.0:1779690630.025111:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690630.555379:0:74892:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690630.555386:0:74892:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690630.556450:0:74892:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 16 00000040:00080000:3.0:1779690630.556457:0:74892:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690630.593853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.593900:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.593933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.593956:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.593972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.593987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.594006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690630.594032:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858944 00000100:00100000:3.0:1779690630.594040:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858944 00000100:00100000:3.0:1779690630.594086:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859456 00000100:00100000:3.0:1779690630.594088:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859456 00000100:00100000:3.0:1779690630.594103:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859072 00000100:00100000:3.0:1779690630.594106:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859072 00000100:00100000:3.0:1779690630.594121:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859328 00000100:00100000:3.0:1779690630.594123:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859328 00000100:00100000:3.0:1779690630.594141:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3023 00000100:00100000:3.0:1779690630.594150:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503858944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594212:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503858944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594229:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3023 00000100:00100000:3.0:1779690630.594247:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3024 00000100:00100000:3.0:1779690630.594253:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503859456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594276:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503859456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594283:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3024 00000100:00100000:3.0:1779690630.594292:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3025 00000100:00100000:3.0:1779690630.594299:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503859072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594320:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503859072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594326:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3025 00000100:00100000:3.0:1779690630.594337:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3026 00000100:00100000:3.0:1779690630.594343:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503859328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594364:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503859328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594370:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3026 00000100:00100000:3.0:1779690630.594388:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859200 00000100:00100000:3.0:1779690630.594391:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859200 00000100:00100000:3.0:1779690630.594430:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858816 00000100:00100000:3.0:1779690630.594434:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858816 00000100:00100000:3.0:1779690630.594456:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 334 00000100:00100000:3.0:1779690630.594462:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503859200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594492:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503859200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594504:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 334 00000100:00100000:3.0:1779690630.594516:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 335 00000100:00100000:3.0:1779690630.594522:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503858816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690630.594549:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503858816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690630.594555:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 335 00000100:00100000:1.0:1779690630.594719:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503858688 00000100:00100000:1.0:1779690630.594723:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503858688 00000100:00100000:1.0:1779690630.594752:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00100000:1.0:1779690630.594759:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503858688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690630.594785:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503858688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690630.594791:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00080000:3.0:1779690630.595016:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690630.595021:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690630.595024:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1779690630.601991:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690631.049159:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690631.049167:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690631.049404:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690631.049431:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690631.625336:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690632.072999:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690632.073008:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690632.073049:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690632.073055:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690632.149664:0:74943:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690632.149673:0:74943:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690632.149756:0:74943:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:2.0:1779690632.149764:0:74943:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690632.649701:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690633.097177:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690633.097187:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690633.097231:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690633.097238:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690633.161284:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492377856:0@lo:400:kworker.0 00000100:00100000:2.0:1779690633.161556:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492378112:0@lo:400:kworker.0 00000100:00100000:0.0:1779690633.161687:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690633.161745:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492378368:0@lo:400:kworker.0 00000100:00100000:0.0:1779690633.161771:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690633.161799:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1779690633.161833:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492377984:0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.161867:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690633.161898:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492378496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690633.161926:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690633.161964:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377856 00000100:00100000:3.0:1779690633.161973:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377856 00000100:00100000:2.0:1779690633.161974:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690633.162023:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378368 00000100:00100000:3.0:1779690633.162026:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378368 00000100:00100000:3.0:1779690633.162056:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377984 00000100:00100000:3.0:1779690633.162071:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377984 00000100:00100000:3.0:1779690633.162098:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1779690633.162107:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492377856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.162158:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492377856:12345-0@lo:400:kworker.0 Request processed in 52us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690633.162165:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1779690633.162179:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378112 00000100:00100000:2.0:1779690633.162183:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378112 00000100:00100000:3.0:1779690633.162190:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1779690633.162200:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492378368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690633.162221:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:2.0:1779690633.162229:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492378112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.162233:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492378368:12345-0@lo:400:kworker.0 Request processed in 34us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690633.162241:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1779690633.162258:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1779690633.162264:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492378112:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690633.162270:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492377984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690633.162274:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:3.0:1779690633.162314:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492377984:12345-0@lo:400:kworker.0 Request processed in 49us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690633.162319:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:3.0:1779690633.162346:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690633.162350:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690633.162365:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492377728:0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.162386:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492377984:0@lo:400:kworker.0 00000100:00100000:0.0:1779690633.162409:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690633.162509:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492378240:0@lo:400:kworker.0 00000100:00100000:0.0:1779690633.162533:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690633.162559:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492377856:0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.162591:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378240 00000100:00100000:3.0:1779690633.162595:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378240 00000100:00100000:2.0:1779690633.162614:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378496 00000100:00100000:2.0:1779690633.162618:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378496 00000100:00100000:3.0:1779690633.162628:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:3.0:1779690633.162636:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492378240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690633.162643:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1779690633.162650:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492378496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690633.162673:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690633.162709:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492378368:0@lo:400:kworker.0 00000100:00100000:1.0:1779690633.162753:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690633.162753:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492377728 00000100:00100000:0.0:1779690633.162756:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492377728 00000100:00100000:1.0:1779690633.162765:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492378624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690633.162779:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1779690633.162785:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492377728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690633.162830:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492378240:12345-0@lo:400:kworker.0 Request processed in 194us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690633.162838:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00080000:3.0:1779690633.162865:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690633.162991:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492378496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 342us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690633.162998:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1779690633.163199:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492378112:0@lo:400:kworker.0 00000100:00100000:1.0:1779690633.163201:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690633.163208:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492377728:12345-0@lo:400:kworker.0 Request processed in 421us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690633.163215:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1779690633.163254:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492378496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690633.163264:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492377728:0@lo:400:kworker.0 00000100:00100000:0.0:1779690633.163279:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492378240:0@lo:400:kworker.0 00000100:00100000:2.0:1779690633.163925:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378624 00000100:00100000:2.0:1779690633.163931:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378624 00000100:00100000:2.0:1779690633.163966:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1779690633.163977:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492378624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690633.164167:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690633.164217:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492378624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690633.164223:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1779690633.164868:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492378624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690633.678089:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690633.765008:0:74997:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690633.765017:0:74997:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690633.765174:0:74997:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:2.0:1779690633.765182:0:74997:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690634.121362:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690634.121370:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690634.121593:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690634.121602:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690634.697014:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690635.145297:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690635.145305:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690635.145361:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690635.145381:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690635.340964:0:75049:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690635.340974:0:75049:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690635.341064:0:75049:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690635.341070:0:75049:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690635.714570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690635.714613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690635.714646:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859584 00000100:00100000:1.0:1779690635.714656:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859584 00000100:00100000:0.0:1779690635.714688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690635.714726:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:0.0:1779690635.714732:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690635.714741:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503859584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690635.714781:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860096 00000100:00100000:2.0:1779690635.714792:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860096 00000100:00100000:1.0:1779690635.714838:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503859584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690635.714847:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:2.0:1779690635.714857:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 339 00000100:00100000:2.0:1779690635.714866:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503860096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690635.714904:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503860096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690635.714912:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 339 00000100:00080000:2.0:1779690635.714949:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690635.716178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690635.716213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690635.716275:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859712 00000100:00100000:1.0:1779690635.716281:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859712 00000100:00100000:1.0:1779690635.716348:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 340 00000100:00100000:1.0:1779690635.716356:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503859712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690635.716511:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503859712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690635.716518:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 340 00000100:00100000:3.0:1779690635.716922:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859840 00000100:00100000:3.0:1779690635.716927:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859840 00000100:00100000:3.0:1779690635.716965:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860352 00000100:00100000:3.0:1779690635.716968:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860352 00000100:00100000:3.0:1779690635.716991:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3029 00000100:00100000:3.0:1779690635.716998:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503859840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690635.717028:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503859840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690635.717035:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3029 00000100:00100000:3.0:1779690635.717050:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3030 00000100:00100000:3.0:1779690635.717056:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503860352:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690635.717078:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503860352:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690635.717083:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3030 00000100:00080000:3.0:1779690635.717204:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690635.717208:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690635.717211:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690635.717761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690635.717835:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503859968 00000100:00100000:3.0:1779690635.717839:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503859968 00000100:00100000:3.0:1779690635.717876:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860224 00000100:00100000:3.0:1779690635.717879:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860224 00000100:00100000:3.0:1779690635.717897:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3031 00000100:00100000:3.0:1779690635.717912:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503859968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690635.717947:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503859968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690635.717954:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3031 00000100:00100000:3.0:1779690635.717967:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3032 00000100:00100000:3.0:1779690635.717973:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503860224:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690635.717993:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503860224:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690635.717999:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3032 00000100:00080000:0.0:1779690635.718707:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690635.718711:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1779690635.723674:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690636.170044:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690636.170052:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690636.170092:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690636.170099:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690636.745948:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690636.963667:0:75100:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690636.963676:0:75100:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690636.963768:0:75100:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690636.963774:0:75100:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690637.193000:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690637.193008:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690637.193050:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690637.193058:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690637.770116:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690638.220335:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690638.220350:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690638.220396:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690638.220402:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690638.281096:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492378752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690638.281180:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690638.281389:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378752 00000100:00100000:1.0:1779690638.281398:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378752 00000100:00100000:1.0:1779690638.281462:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1779690638.281471:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492378752:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1779690638.281488:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1779690638.281506:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690638.281560:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492378752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690638.281567:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1779690638.281913:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492378752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690638.281931:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690638.281938:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492378880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690638.281968:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690638.282787:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492379392:0@lo:400:kworker.0 00000100:00100000:3.0:1779690638.282848:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690638.282873:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690638.282881:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492379264:0@lo:400:kworker.0 00000100:00100000:0.0:1779690638.282898:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492379136:0@lo:400:kworker.0 00000100:00100000:3.0:1779690638.282911:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690638.282957:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379392 00000100:00100000:0.0:1779690638.282962:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379392 00000100:00100000:3.0:1779690638.282978:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379264 00000100:00100000:3.0:1779690638.282984:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379264 00000100:00100000:0.0:1779690638.283003:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1779690638.283013:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690638.283029:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1779690638.283039:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492379264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690638.283060:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492379392:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690638.283067:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1779690638.283085:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492379264:12345-0@lo:400:kworker.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690638.283093:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1779690638.283099:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690638.283120:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690638.283126:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492379008:0@lo:400:kworker.0 00000100:00100000:0.0:1779690638.283156:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690638.283190:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379008 00000100:00100000:0.0:1779690638.283193:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379008 00000100:00100000:0.0:1779690638.283218:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1779690638.283226:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492379008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690638.283255:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492379264:0@lo:400:kworker.0 00000100:00100000:3.0:1779690638.283285:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379136 00000100:00100000:3.0:1779690638.283290:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379136 00000100:00100000:2.0:1779690638.283291:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492378880 00000100:00100000:2.0:1779690638.283297:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492378880 00000100:00100000:3.0:1779690638.283324:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1779690638.283334:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492379136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690638.283349:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1779690638.283361:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492378880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690638.283389:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690638.283414:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492379008:12345-0@lo:400:kworker.0 Request processed in 189us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690638.283421:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1779690638.283422:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492378880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690638.283427:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1779690638.283454:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492379008:0@lo:400:kworker.0 00000100:00080000:0.0:1779690638.283488:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690638.283492:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690638.283501:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492378880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690638.285550:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492379392:0@lo:400:kworker.0 00000100:00100000:3.0:1779690638.286896:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492379136:12345-0@lo:400:kworker.0 Request processed in 3560us (3795us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690638.286908:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1779690638.289462:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492379136:0@lo:400:kworker.0 00000040:00080000:3.0:1779690638.705672:0:75153:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690638.705679:0:75153:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690638.705730:0:75153:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690638.705734:0:75153:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690638.794969:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690639.241087:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690639.241095:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690639.241156:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690639.241163:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690639.816940:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690640.264989:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690640.264997:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690640.265037:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690640.265045:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690640.331604:0:75204:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690640.331612:0:75204:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690640.331703:0:75204:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690640.331710:0:75204:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690640.836411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690640.836469:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690640.836496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690640.836541:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690640.836566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690640.836589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690640.836613:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860864 00000100:00100000:1.0:1779690640.836623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690640.836631:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860864 00000100:00100000:1.0:1779690640.836656:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860480 00000100:00100000:1.0:1779690640.836665:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860480 00000100:00100000:1.0:1779690640.836721:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:3.0:1779690640.836725:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861120 00000100:00100000:3.0:1779690640.836730:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861120 00000100:00100000:1.0:1779690640.836734:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503860480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690640.836799:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503860480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690640.836834:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:1.0:1779690640.836874:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861248 00000100:00100000:1.0:1779690640.836878:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861248 00000100:00100000:3.0:1779690640.836887:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860736 00000100:00100000:3.0:1779690640.836894:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860736 00000100:00100000:1.0:1779690640.836918:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3033 00000100:00100000:1.0:1779690640.836928:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503860864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690640.836965:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3034 00000100:00100000:1.0:1779690640.836965:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503860864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690640.836980:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3033 00000100:00100000:3.0:1779690640.836988:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503861120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690640.837025:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3035 00000100:00100000:1.0:1779690640.837036:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503861248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690640.837058:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503861120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 76us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690640.837083:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503861248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690640.837094:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3034 00000100:00100000:0.0:1779690640.837176:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860608 00000100:00100000:0.0:1779690640.837182:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860608 00000100:00100000:0.0:1779690640.837223:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503860992 00000100:00100000:0.0:1779690640.837226:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503860992 00000100:00100000:0.0:1779690640.837253:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 344 00000100:00100000:0.0:1779690640.837259:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503860608:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690640.837287:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503860608:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690640.837293:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 344 00000100:00100000:0.0:1779690640.837304:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 345 00000100:00100000:0.0:1779690640.837309:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503860992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690640.837340:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503860992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690640.837345:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 345 00000100:00080000:0.0:1779690640.837364:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690640.837368:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690640.837371:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690640.839759:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3035 00000100:00100000:3.0:1779690640.839780:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3036 00000100:00100000:3.0:1779690640.839835:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503860736:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690640.839954:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503860736:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 161us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690640.839962:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3036 00010000:00010000:3.0:1779690640.842374:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690641.289074:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690641.289082:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690641.289131:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690641.289139:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690641.865464:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690642.170568:0:75256:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690642.170576:0:75256:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690642.170665:0:75256:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:2.0:1779690642.170673:0:75256:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690642.313092:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690642.313104:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690642.313152:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690642.313161:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690642.890372:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690643.337997:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690643.338004:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690643.338041:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690643.338048:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690643.401923:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690643.401943:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492379520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690643.402007:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690643.402070:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379520 00000100:00100000:2.0:1779690643.402089:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379520 00000100:00100000:2.0:1779690643.402139:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1779690643.402148:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492379520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690643.402190:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690643.402232:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492379520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690643.402240:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00080000:2.0:1779690643.402261:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690643.402306:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492379520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690643.402586:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492379776:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.402620:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690643.402641:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690643.402647:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492379904:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.402668:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690643.402696:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379776 00000100:00100000:2.0:1779690643.402700:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379776 00000100:00100000:2.0:1779690643.402732:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379904 00000100:00100000:2.0:1779690643.402735:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379904 00000100:00100000:2.0:1779690643.402755:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1779690643.402762:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492379776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.402794:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492379776:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690643.402801:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1779690643.402841:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1779690643.402847:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492379904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.402872:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492379904:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690643.402885:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:2.0:1779690643.402907:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690643.402925:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492379904:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.402934:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492379776:0@lo:400:kworker.0 00000100:00100000:3.0:1779690643.403534:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492379648:0@lo:400:kworker.0 00000100:00100000:3.0:1779690643.403571:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690643.403613:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492380160:0@lo:400:kworker.0 00000100:00100000:3.0:1779690643.403635:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690643.403655:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690643.403660:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492380032:0@lo:400:kworker.0 00000100:00100000:3.0:1779690643.403684:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690643.403707:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380160 00000100:00100000:3.0:1779690643.403711:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380160 00000100:00100000:3.0:1779690643.403736:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1779690643.403743:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492380160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690643.403779:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492380160:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690643.403785:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1779690643.403832:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492380160:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.403961:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492379648 00000100:00100000:2.0:1779690643.403966:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492379648 00000100:00100000:2.0:1779690643.404000:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1779690643.404007:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492379648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.404041:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492379648:12345-0@lo:400:kworker.0 Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690643.404047:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1779690643.404071:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380032 00000100:00100000:2.0:1779690643.404074:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380032 00000100:00100000:2.0:1779690643.404109:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:2.0:1779690643.404116:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492380032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.404144:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492380032:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690643.404150:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00080000:2.0:1779690643.404164:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690643.404181:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492380032:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.404189:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492379648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690643.406159:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492380288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690643.406211:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690643.406387:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380288 00000100:00100000:0.0:1779690643.406395:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380288 00000100:00100000:0.0:1779690643.406472:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1779690643.406481:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492380288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690643.406511:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690643.406561:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492380288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690643.406569:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1779690643.406645:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492380288:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1779690643.877751:0:75307:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690643.877758:0:75307:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690643.878704:0:75307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:3.0:1779690643.878710:0:75307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690643.913073:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690644.361077:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690644.361084:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690644.361126:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690644.361133:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690644.937021:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690645.386147:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690645.386156:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690645.386198:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690645.386205:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690645.481337:0:75358:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690645.481344:0:75358:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690645.481429:0:75358:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690645.481435:0:75358:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690645.952501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690645.952554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690645.952632:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690645.952686:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690645.952742:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861888 00000100:00100000:0.0:1779690645.952751:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861888 00000100:00100000:0.0:1779690645.952853:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 349 00000100:00100000:0.0:1779690645.952863:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503861888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690645.952939:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503861888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690645.952945:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 349 00000100:00100000:2.0:1779690645.953189:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861376 00000100:00100000:2.0:1779690645.953200:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861376 00000100:00100000:0.0:1779690645.953301:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:0.0:1779690645.953327:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503861376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690645.953364:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503861376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (871us total) trans 0 rc 0/0 00000100:00080000:2.0:1779690645.953365:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690645.953374:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:3.0:1779690645.953519:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861632 00000100:00100000:3.0:1779690645.953525:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861632 00000100:00100000:2.0:1779690645.953789:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862144 00000100:00100000:2.0:1779690645.953793:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862144 00000100:00100000:0.0:1779690645.953819:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3038 00000100:00100000:0.0:1779690645.953830:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503861632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690645.953868:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503861632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690645.953875:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3038 00000100:00100000:2.0:1779690645.953948:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3039 00000100:00100000:2.0:1779690645.953956:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503862144:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690645.953990:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503862144:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690645.953997:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3039 00000100:00080000:2.0:1779690645.954012:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690645.954015:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690645.954140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690645.954169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690645.954183:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861504 00000100:00100000:2.0:1779690645.954187:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861504 00000100:00100000:2.0:1779690645.954218:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 350 00000100:00100000:1.0:1779690645.954218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690645.954226:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503861504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690645.954254:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503861504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690645.954255:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503861760 00000100:00100000:2.0:1779690645.954274:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 350 00000100:00100000:1.0:1779690645.954274:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503861760 00000100:00080000:2.0:1779690645.954298:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690645.954301:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690645.954319:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862016 00000100:00100000:1.0:1779690645.954323:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862016 00000100:00100000:2.0:1779690645.954334:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3040 00000100:00100000:2.0:1779690645.954344:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503861760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690645.954365:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3041 00000100:00100000:1.0:1779690645.954384:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503862016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690645.954387:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503861760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690645.954396:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3040 00000100:00080000:2.0:1779690645.954439:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690645.954991:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503862016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690645.954999:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3041 00010000:00010000:0.0:1779690645.960964:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690646.409049:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690646.409058:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690646.409101:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690646.409109:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690646.986633:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690647.061615:0:75409:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690647.061629:0:75409:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690647.061746:0:75409:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:2.0:1779690647.061754:0:75409:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690647.433072:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690647.433080:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690647.433113:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690647.433119:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690648.009453:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690648.458420:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690648.458433:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690648.458481:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:1.0:1779690648.458490:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690648.521138:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492380416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.521231:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690648.521375:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1779690648.521382:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492380928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690648.521417:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690648.521450:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492381056:0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.521485:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690648.521499:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492380544:0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.521517:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381056 00000100:00100000:0.0:1779690648.521525:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381056 00000100:00100000:2.0:1779690648.521531:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690648.521549:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492381184:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.521569:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690648.521608:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690648.521639:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690648.521671:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380928 00000100:00100000:3.0:1779690648.521675:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380928 00000100:00100000:0.0:1779690648.521755:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381184 00000100:00100000:0.0:1779690648.521759:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381184 00000100:00100000:0.0:1779690648.521789:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1779690648.521798:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492381056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.521876:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492381056:12345-0@lo:400:kworker.0 Request processed in 78us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690648.521884:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1779690648.521902:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1779690648.521909:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492381184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.521935:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492381184:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690648.521941:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:1.0:1779690648.522184:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380416 00000100:00100000:1.0:1779690648.522189:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380416 00000100:00100000:1.0:1779690648.522226:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1779690648.522243:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492380416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690648.522281:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492380416:12345-0@lo:400:kworker.0 Request processed in 49us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690648.522288:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1779690648.522344:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492381184:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.522366:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1779690648.522373:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492380672:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.522400:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690648.522438:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380544 00000100:00100000:0.0:1779690648.522442:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380544 00000100:00100000:0.0:1779690648.522479:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380672 00000100:00100000:0.0:1779690648.522481:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380672 00000100:00100000:3.0:1779690648.522501:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492380800 00000100:00100000:0.0:1779690648.522503:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1779690648.522505:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492380800 00000100:00100000:0.0:1779690648.522509:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492380544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.522522:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492381312:0@lo:400:kworker.0 00000100:00100000:3.0:1779690648.522523:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1779690648.522532:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aeae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492380928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690648.522546:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492380544:12345-0@lo:400:kworker.0 Request processed in 38us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690648.522556:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690648.522556:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00002000:00000024:3.0:1779690648.522566:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690648.522573:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381312 00000100:00100000:0.0:1779690648.522576:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381312 00000100:00100000:2.0:1779690648.522586:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492380544:0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.522593:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1779690648.522602:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690648.522608:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aeae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492380928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690648.522615:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1779690648.522626:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1779690648.522633:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690648.522652:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690648.522657:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1779690648.522666:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492381312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.522688:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690648.522694:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1779690648.522711:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492381312:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690648.522723:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:2.0:1779690648.522729:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690648.522734:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690648.522736:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690648.522757:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492381312:0@lo:400:kworker.0 00000100:00100000:0.0:1779690648.523086:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492380672:12345-0@lo:400:kworker.0 Request processed in 484us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690648.523094:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1779690648.523104:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492381056:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.523118:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492380928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690648.523165:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492380672:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.523408:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492380416:0@lo:400:kworker.0 00000100:00100000:2.0:1779690648.523700:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492380800:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1779690648.759522:0:75460:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690648.759531:0:75460:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690648.759627:0:75460:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690648.759634:0:75460:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690649.033130:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690649.481044:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690649.481051:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690649.481092:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:1.0:1779690649.481100:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690650.057050:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690650.306323:0:75512:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690650.306342:0:75512:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690650.306606:0:75512:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 15 00000040:00080000:0.0:1779690650.306611:0:75512:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690650.505028:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690650.505035:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690650.507458:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 14 00000040:00080000:1.0:1779690650.507471:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690651.074196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690651.074247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690651.074324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690651.074354:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690651.074407:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862784 00000100:00100000:0.0:1779690651.074416:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862784 00000100:00100000:0.0:1779690651.074475:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 354 00000100:00100000:0.0:1779690651.074486:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503862784:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690651.074556:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503862784:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690651.074564:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 354 00000100:00100000:2.0:1779690651.076302:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862272 00000100:00100000:2.0:1779690651.076314:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862272 00000100:00100000:2.0:1779690651.076373:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00100000:2.0:1779690651.076382:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503862272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690651.076442:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503862272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 61us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690651.076448:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00080000:2.0:1779690651.076480:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690651.080616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690651.080641:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690651.080766:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862528 00000100:00100000:3.0:1779690651.080774:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862528 00000100:00100000:3.0:1779690651.080851:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863040 00000100:00100000:3.0:1779690651.080855:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863040 00000100:00080000:0.0:1779690651.080861:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690651.080868:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690651.080886:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3044 00000100:00100000:0.0:1779690651.080899:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3045 00000100:00100000:3.0:1779690651.080900:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503862528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690651.080913:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503863040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690651.080976:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503863040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690651.080984:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3045 00000100:00100000:3.0:1779690651.081019:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503862528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 123us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690651.081034:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3044 00000100:00100000:3.0:1779690651.081075:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862400 00000100:00100000:3.0:1779690651.081079:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862400 00000100:00100000:3.0:1779690651.081115:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 355 00000100:00100000:3.0:1779690651.081122:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503862400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690651.081154:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503862400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690651.081161:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 355 00000100:00080000:3.0:1779690651.081179:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690651.081426:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862656 00000100:00100000:2.0:1779690651.081431:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862656 00000100:00100000:2.0:1779690651.081472:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3046 00000100:00100000:2.0:1779690651.081480:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503862656:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690651.081516:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503862656:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690651.081522:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3046 00000100:00100000:2.0:1779690651.081560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690651.081601:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503862912 00000100:00100000:2.0:1779690651.081605:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503862912 00000100:00100000:2.0:1779690651.081628:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3047 00000100:00100000:2.0:1779690651.081634:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503862912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690651.081665:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503862912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690651.081682:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3047 00010000:00010000:2.0:1779690651.081733:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1779690651.081940:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690651.081944:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1779690651.530399:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690651.530411:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690651.530462:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 14 00000040:00080000:1.0:1779690651.530473:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690651.932692:0:75563:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690651.932700:0:75563:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690651.932782:0:75563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 14 00000040:00080000:0.0:1779690651.932789:0:75563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690652.105263:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690652.553137:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690652.553145:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690652.553428:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 13 00000040:00080000:1.0:1779690652.553437:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690653.129298:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690653.471513:0:75616:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690653.471519:0:75616:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690653.471602:0:75616:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 13 00000040:00080000:0.0:1779690653.471608:0:75616:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690653.580440:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690653.580447:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690653.580677:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:2.0:1779690653.580683:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690653.641179:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690653.641212:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492381440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690653.641279:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690653.641335:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492381568:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.641354:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492381824:0@lo:400:kworker.0 00000100:00100000:3.0:1779690653.641474:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381440 00000100:00100000:3.0:1779690653.641481:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381440 00000100:00100000:3.0:1779690653.641530:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1779690653.641538:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492381440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690653.641579:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690653.641638:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492381952:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.642678:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690653.642726:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492382336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690653.642758:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690653.642795:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381824 00000100:00100000:0.0:1779690653.642800:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381824 00000100:00100000:0.0:1779690653.642850:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1779690653.642857:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492381824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.642897:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492381824:12345-0@lo:400:kworker.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690653.642905:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1779690653.642948:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492381824:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.642983:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492381696:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643008:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690653.643028:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690653.643042:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492382208:0@lo:400:kworker.0 00000100:00100000:1.0:1779690653.643068:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492382080:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643071:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690653.643109:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690653.643112:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381696 00000100:00100000:0.0:1779690653.643116:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381696 00000100:00100000:0.0:1779690653.643147:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382208 00000100:00100000:0.0:1779690653.643150:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382208 00000100:00100000:1.0:1779690653.643154:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381568 00000100:00100000:1.0:1779690653.643160:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381568 00000100:00100000:0.0:1779690653.643171:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1779690653.643180:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492381696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690653.643194:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1779690653.643215:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643235:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492381696:12345-0@lo:400:kworker.0 Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690653.643241:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1779690653.643253:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1779690653.643259:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492382208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643284:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492382208:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690653.643289:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1779690653.643318:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492381696:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643327:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492382208:0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643360:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382080 00000100:00100000:1.0:1779690653.643364:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492381568:12345-0@lo:400:kworker.0 Request processed in 149us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690653.643365:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382080 00000100:00100000:1.0:1779690653.643374:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1779690653.643399:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1779690653.643408:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492382080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690653.643442:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492382080:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690653.643447:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:1.0:1779690653.643461:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492381568:0@lo:400:kworker.0 00000100:00100000:1.0:1779690653.643476:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492382080:0@lo:400:kworker.0 00000100:00100000:3.0:1779690653.645070:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492381440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3527us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690653.645081:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1779690653.645108:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382336 00000100:00100000:3.0:1779690653.645114:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382336 00000100:00100000:3.0:1779690653.645138:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1779690653.645145:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492382336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690653.645175:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690653.645224:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492382336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690653.645239:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00080000:3.0:1779690653.645262:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690653.645267:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690653.645269:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690653.647719:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492382336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690653.647753:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492381440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690653.648113:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690653.648328:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492381952 00000100:00100000:3.0:1779690653.648334:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492381952 00000100:00100000:3.0:1779690653.648414:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1779690653.648422:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492381952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690653.648476:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492381952:12345-0@lo:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690653.648482:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:2.0:1779690653.648539:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492381952:0@lo:400:kworker.0 00010000:00010000:2.0:1779690654.152984:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690654.601481:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690654.601491:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690654.601544:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690654.601554:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690655.022241:0:75667:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690655.022248:0:75667:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690655.022318:0:75667:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:1.0:1779690655.022325:0:75667:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690655.177376:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690655.625246:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690655.625254:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690655.625289:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690655.625296:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690656.197489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.197528:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.197562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690656.197590:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863552 00000100:00100000:1.0:1779690656.197599:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863552 00000100:00100000:0.0:1779690656.197608:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863296 00000100:00100000:0.0:1779690656.197613:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863296 00000100:00100000:1.0:1779690656.197659:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863808 00000100:00100000:1.0:1779690656.197662:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863808 00000100:00100000:0.0:1779690656.197670:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 359 00000100:00100000:0.0:1779690656.197682:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503863296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690656.197691:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3050 00000100:00100000:1.0:1779690656.197700:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503863552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690656.197783:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503863296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690656.197790:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 359 00000100:00100000:3.0:1779690656.198864:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3051 00000100:00100000:3.0:1779690656.198874:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503863808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690656.199335:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503863552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1635us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690656.199344:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3050 00000100:00080000:1.0:1779690656.199369:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690656.199384:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690656.199387:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690656.201442:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.201485:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.201518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.201543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690656.201573:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863424 00000100:00100000:2.0:1779690656.201580:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863424 00000100:00100000:2.0:1779690656.201734:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863936 00000100:00100000:2.0:1779690656.201738:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863936 00000100:00100000:2.0:1779690656.201763:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3052 00000100:00100000:2.0:1779690656.201772:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503863424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690656.201839:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503863424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690656.201846:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3052 00000100:00100000:2.0:1779690656.201874:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3053 00000100:00100000:2.0:1779690656.201880:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503863936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690656.201905:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503863936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690656.201910:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3053 00000100:00100000:2.0:1779690656.201927:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863168 00000100:00100000:2.0:1779690656.201930:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863168 00000100:00100000:2.0:1779690656.201954:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1779690656.201959:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503863168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690656.201982:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503863168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690656.201988:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1779690656.202013:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503863680 00000100:00100000:2.0:1779690656.202016:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503863680 00000100:00100000:2.0:1779690656.202044:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 360 00000100:00100000:2.0:1779690656.202051:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503863680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690656.202077:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503863680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690656.202083:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 360 00010000:00010000:2.0:1779690656.202222:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1779690656.202795:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690656.202800:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690656.202816:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690656.206701:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503863808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 7818us (9127us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690656.206714:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3051 00000040:00080000:3.0:1779690656.585518:0:75719:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690656.585527:0:75719:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690656.585656:0:75719:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:3.0:1779690656.585661:0:75719:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690656.650095:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690656.650103:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690656.650140:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690656.650147:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690657.225145:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690657.672982:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690657.672991:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690657.673046:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690657.673055:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690658.127443:0:75770:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690658.127450:0:75770:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690658.127535:0:75770:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:2.0:1779690658.127543:0:75770:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690658.250282:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690658.697262:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690658.697270:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690658.697318:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690658.697325:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690658.760997:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690658.761026:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492382592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690658.761031:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492382464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690658.761206:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492382848:0@lo:400:kworker.0 00000100:00100000:1.0:1779690658.761216:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492383104:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.761528:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690658.761584:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492382720:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.761627:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690658.761649:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383232:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.761667:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690658.761695:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383232 00000100:00100000:0.0:1779690658.761701:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383232 00000100:00100000:0.0:1779690658.761744:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1779690658.761751:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.761794:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383232:12345-0@lo:400:kworker.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690658.761800:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1779690658.761855:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383232:0@lo:400:kworker.0 00000100:00080000:0.0:1779690658.761886:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690658.761896:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382720 00000100:00100000:0.0:1779690658.761900:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382720 00000100:00100000:0.0:1779690658.761924:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1779690658.761930:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492382720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.761964:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492382720:12345-0@lo:400:kworker.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690658.761969:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1779690658.761999:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492382720:0@lo:400:kworker.0 00000100:00100000:2.0:1779690658.762264:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690658.762278:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382592 00000100:00100000:0.0:1779690658.762284:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382592 00000100:00100000:2.0:1779690658.762293:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492382976:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.762321:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382464 00000100:00100000:0.0:1779690658.762324:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382464 00000100:00100000:2.0:1779690658.762329:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690658.762342:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1779690658.762350:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492382592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690658.762365:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382976 00000100:00100000:2.0:1779690658.762370:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382976 00002000:00000024:0.0:1779690658.762376:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690658.762408:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1779690658.762417:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492382592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690658.762418:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492382976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.762429:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1779690658.762462:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492382976:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690658.762469:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1779690658.762498:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492382976:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.762530:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1779690658.762536:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492382464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690658.762553:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690658.762587:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492382464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690658.762594:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1779690658.762621:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492382464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690658.762634:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1779690658.762668:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690658.762670:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383104 00000100:00080000:0.0:1779690658.762671:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690658.762674:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383104 00000100:00100000:0.0:1779690658.762691:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492382592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690658.762836:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:1.0:1779690658.762849:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492383104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690658.762888:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492383104:12345-0@lo:400:kworker.0 Request processed in 36us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690658.762894:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1779690658.762954:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690658.762972:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492383360:0@lo:400:kworker.0 00000100:00100000:3.0:1779690658.762994:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690658.763029:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492382848 00000100:00100000:3.0:1779690658.763042:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492382848 00000100:00100000:3.0:1779690658.763074:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383360 00000100:00100000:3.0:1779690658.763077:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383360 00000100:00100000:3.0:1779690658.763094:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1779690658.763099:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492382848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690658.763134:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492382848:12345-0@lo:400:kworker.0 Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690658.763139:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1779690658.763143:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1779690658.763151:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492383360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690658.763180:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492382848:0@lo:400:kworker.0 00000100:00100000:0.0:1779690658.763193:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492383360:12345-0@lo:400:kworker.0 Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690658.763200:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1779690658.763206:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492383360:0@lo:400:kworker.0 00000100:00080000:0.0:1779690658.763216:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690658.763232:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492383104:0@lo:400:kworker.0 00010000:00010000:0.0:1779690659.273427:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690659.721103:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690659.721111:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690659.721176:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690659.721334:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690659.763305:0:75822:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690659.763311:0:75822:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690659.763391:0:75822:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:3.0:1779690659.763395:0:75822:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690660.296958:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690660.745045:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690660.745053:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690660.745096:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690660.745104:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690661.312441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.312529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.312563:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.312591:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.312612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.312631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690661.312671:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864448 00000100:00100000:3.0:1779690661.312680:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864448 00000100:00100000:3.0:1779690661.312735:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864704 00000100:00100000:3.0:1779690661.312738:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864704 00000100:00100000:3.0:1779690661.312760:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864320 00000100:00100000:3.0:1779690661.312763:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864320 00000100:00100000:3.0:1779690661.312790:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3056 00000100:00100000:3.0:1779690661.312800:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503864448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690661.312898:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503864448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690661.312907:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3056 00000100:00100000:3.0:1779690661.312926:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3057 00000100:00100000:3.0:1779690661.312934:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503864704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690661.312971:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503864704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690661.312978:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3057 00000100:00100000:3.0:1779690661.312991:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3058 00000100:00100000:3.0:1779690661.312998:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503864320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690661.313022:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503864320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690661.313028:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3058 00000100:00080000:3.0:1779690661.313045:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690661.313049:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690661.313205:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864064 00000100:00100000:3.0:1779690661.313209:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864064 00000100:00100000:3.0:1779690661.313234:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1779690661.313252:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503864064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690661.313281:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503864064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690661.313287:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:0.0:1779690661.315513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690661.315542:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864832 00000100:00100000:0.0:1779690661.315549:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864832 00000100:00100000:0.0:1779690661.315602:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3059 00000100:00100000:0.0:1779690661.315611:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503864832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690661.315671:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503864832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690661.315678:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3059 00000100:00080000:0.0:1779690661.315698:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690661.316124:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864192 00000100:00100000:1.0:1779690661.316129:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864192 00000100:00100000:1.0:1779690661.316186:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864576 00000100:00100000:1.0:1779690661.316189:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864576 00000100:00100000:1.0:1779690661.316220:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 364 00000100:00100000:1.0:1779690661.316227:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503864192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690661.316261:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503864192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (3829us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690661.316268:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 364 00000100:00100000:1.0:1779690661.316280:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 365 00000100:00100000:1.0:1779690661.316285:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503864576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690661.316303:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503864576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 19us (3671us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690661.316317:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 365 00000100:00080000:0.0:1779690661.316515:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690661.323524:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690661.341029:0:75874:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690661.341038:0:75874:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690661.341125:0:75874:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:1.0:1779690661.341131:0:75874:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690661.770116:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690661.770125:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690661.770185:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 12 00000040:00080000:0.0:1779690661.770218:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690662.345024:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690662.792995:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690662.793005:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690662.793314:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 11 00000040:00080000:0.0:1779690662.793322:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690662.897576:0:75925:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690662.897583:0:75925:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690662.898111:0:75925:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 11 00000040:00080000:3.0:1779690662.898117:0:75925:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690663.369098:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690663.817058:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690663.817068:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690663.817430:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 10 00000040:00080000:0.0:1779690663.817437:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690663.880989:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1779690663.881009:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690663.881013:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492383744:0@lo:400:kworker.0 00000100:00100000:0.0:1779690663.881089:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492384000:0@lo:400:kworker.0 00000100:00100000:1.0:1779690663.881134:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492384256:0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.881233:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690663.881299:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492384128:0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.881336:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690663.881369:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383744 00000100:00100000:3.0:1779690663.881375:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383744 00000100:00100000:3.0:1779690663.881414:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1779690663.881422:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.881467:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492383744:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690663.881474:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1779690663.881519:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492383744:0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.881549:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384128 00000100:00100000:3.0:1779690663.881552:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384128 00000100:00100000:3.0:1779690663.881586:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1779690663.881592:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.881626:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492384128:12345-0@lo:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690663.881632:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00080000:3.0:1779690663.881647:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690663.881669:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492384128:0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.886957:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690663.886957:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690663.886966:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690663.887216:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384000 00000100:00100000:3.0:1779690663.887225:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384000 00000100:00100000:3.0:1779690663.887286:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1779690663.887296:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.887375:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690663.887401:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690663.887426:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492383872:0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.887449:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690663.887469:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384256 00000100:00100000:2.0:1779690663.887474:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492384384:0@lo:400:kworker.0 00000100:00100000:0.0:1779690663.887475:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384256 00000100:00100000:2.0:1779690663.887498:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690663.887518:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:0.0:1779690663.887527:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492384256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.887531:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383616 00000100:00100000:2.0:1779690663.887546:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383616 00000100:00100000:2.0:1779690663.887573:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383488 00000100:00100000:2.0:1779690663.887576:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383488 00000100:00100000:2.0:1779690663.887586:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1779690663.887591:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690663.887616:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690663.887624:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492384256:12345-0@lo:400:kworker.0 Request processed in 42us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690663.887633:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:2.0:1779690663.887654:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690663.887662:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1779690663.887670:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1779690663.887672:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690663.887694:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690663.887715:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690663.887733:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492383488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690663.887734:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492383488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690663.887746:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1779690663.887784:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492383872 00000100:00080000:0.0:1779690663.887784:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690663.887788:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492383872 00000100:00080000:0.0:1779690663.887790:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690663.888857:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384384 00000100:00100000:2.0:1779690663.888862:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384384 00000100:00100000:2.0:1779690663.888875:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1779690663.888882:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492383872:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1779690663.888890:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690663.888933:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492383872:12345-0@lo:400:kworker.0 Request processed in 50us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690663.888938:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1779690663.888946:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1779690663.888952:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492384384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.888978:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492383872:0@lo:400:kworker.0 00000100:00100000:2.0:1779690663.888997:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492384384:0@lo:400:kworker.0 00000100:00100000:0.0:1779690663.888999:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492384384:12345-0@lo:400:kworker.0 Request processed in 49us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690663.889008:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1779690663.891948:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492384256:0@lo:400:kworker.0 00000100:00100000:3.0:1779690663.892327:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492384000:12345-0@lo:400:kworker.0 Request processed in 5032us (5373us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690663.892338:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1779690663.892448:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492384000:0@lo:400:kworker.0 00010000:00010000:2.0:1779690664.394347:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690664.438960:0:75979:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690664.438972:0:75979:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690664.439050:0:75979:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 10 00000040:00080000:3.0:1779690664.439056:0:75979:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690664.841387:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690664.841397:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690664.841442:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 10 00000040:00080000:0.0:1779690664.841450:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690665.417296:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690665.865060:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690665.865068:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690665.866196:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 9 00000040:00080000:0.0:1779690665.866205:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690666.083163:0:76030:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690666.083171:0:76030:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690666.083247:0:76030:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 9 00000040:00080000:0.0:1779690666.083253:0:76030:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690666.433325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433439:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690666.433537:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865472 00000100:00100000:0.0:1779690666.433545:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865472 00000100:00100000:0.0:1779690666.433613:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865088 00000100:00100000:0.0:1779690666.433616:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865088 00000100:00100000:0.0:1779690666.433633:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 369 00000100:00100000:0.0:1779690666.433641:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503865472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690666.433703:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503865472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690666.433711:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 369 00000100:00100000:0.0:1779690666.433725:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 370 00000100:00100000:0.0:1779690666.433730:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503865088:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690666.433748:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503865088:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 18us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690666.433753:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 370 00000100:00100000:0.0:1779690666.433768:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865216 00000100:00100000:0.0:1779690666.433771:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865216 00000100:00100000:0.0:1779690666.433789:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865728 00000100:00100000:0.0:1779690666.433792:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865728 00000100:00100000:0.0:1779690666.433831:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865344 00000100:00100000:0.0:1779690666.433834:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865344 00000100:00100000:0.0:1779690666.433854:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865600 00000100:00100000:0.0:1779690666.433857:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865600 00000100:00100000:0.0:1779690666.433885:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3062 00000100:00100000:1.0:1779690666.433895:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3063 00000100:00100000:0.0:1779690666.433895:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503865216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690666.433919:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503865728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690666.433927:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503865216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690666.433933:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3062 00000100:00100000:0.0:1779690666.433949:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3064 00000100:00100000:0.0:1779690666.433960:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503865344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690666.433962:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503865728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690666.433973:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3063 00000100:00100000:1.0:1779690666.433991:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3065 00000100:00100000:0.0:1779690666.434000:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503865344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 44us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690666.434007:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3064 00000100:00080000:0.0:1779690666.434023:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690666.434026:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690666.434029:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690666.434137:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503865600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690666.434176:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503865600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 178us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690666.434183:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3065 00000100:00100000:3.0:1779690666.435637:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503864960 00000100:00100000:3.0:1779690666.435644:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503864960 00000100:00100000:3.0:1779690666.435693:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:3.0:1779690666.435701:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503864960:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690666.435753:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503864960:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690666.435760:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 237 00010000:00010000:2.0:1779690666.440928:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690666.889042:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690666.889051:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690666.889091:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 9 00000040:00080000:0.0:1779690666.889111:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690667.465143:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690667.592198:0:76081:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690667.592206:0:76081:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690667.592274:0:76081:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 9 00000040:00080000:0.0:1779690667.592280:0:76081:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690667.913150:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690667.913163:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690667.913562:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:0.0:1779690667.913570:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690668.490300:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690668.941245:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690668.941252:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690668.941303:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690668.941311:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690669.000939:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492384512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690669.001003:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690669.001068:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690669.001075:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492384640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690669.001110:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690669.001143:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384512 00000100:00100000:0.0:1779690669.001150:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384512 00000100:00100000:0.0:1779690669.001198:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384640 00000100:00100000:0.0:1779690669.001201:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384640 00000100:00100000:0.0:1779690669.001229:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1779690669.001237:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492384512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690669.001270:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690669.001309:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492384512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690669.001316:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1779690669.001332:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1779690669.001338:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492384640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690669.001355:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690669.001384:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492384640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690669.001390:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00080000:0.0:1779690669.001411:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690669.001415:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690669.001422:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492384768:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.001450:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690669.001471:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690669.001475:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492384896:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.001492:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690669.001520:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384768 00000100:00100000:1.0:1779690669.001523:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384768 00000100:00100000:1.0:1779690669.001560:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1779690669.001566:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492384768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.001600:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492384768:12345-0@lo:400:kworker.0 Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690669.001607:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1779690669.001639:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492384896 00000100:00100000:1.0:1779690669.001642:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492384896 00000100:00100000:1.0:1779690669.001671:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1779690669.001678:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492384896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.001709:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492384896:12345-0@lo:400:kworker.0 Request processed in 32us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690669.001715:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1779690669.001739:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492385152:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002440:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690669.002470:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690669.002477:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492385024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002506:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690669.002534:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385152 00000100:00100000:1.0:1779690669.002539:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385152 00000100:00100000:1.0:1779690669.002563:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385024 00000100:00100000:1.0:1779690669.002566:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385024 00000100:00100000:1.0:1779690669.002584:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1779690669.002589:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492385152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002623:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492385152:12345-0@lo:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690669.002637:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1779690669.002649:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1779690669.002655:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492385024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002683:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492385024:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690669.002689:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1779690669.002730:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492384896:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002745:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492384768:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002987:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492385024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690669.002997:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492385152:0@lo:400:kworker.0 00000100:00100000:0.0:1779690669.005178:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492384640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690669.005200:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492384512:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1779690669.005229:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1779690669.209109:0:76133:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690669.209118:0:76133:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690669.209184:0:76133:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:1.0:1779690669.209190:0:76133:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690669.513261:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690669.961198:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690669.961207:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690669.961264:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690669.961273:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690670.549638:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690670.783616:0:76185:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690670.783624:0:76185:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690670.783691:0:76185:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690670.783699:0:76185:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690670.985042:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690670.985050:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690670.985098:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690670.985106:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690671.552045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552100:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552131:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552212:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690671.552266:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866240 00000100:00100000:2.0:1779690671.552267:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866496 00000100:00100000:2.0:1779690671.552275:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866496 00000100:00100000:0.0:1779690671.552276:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866240 00000100:00100000:2.0:1779690671.552334:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866112 00000100:00100000:2.0:1779690671.552338:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866112 00000100:00100000:1.0:1779690671.552405:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865984 00000100:00100000:1.0:1779690671.552409:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865984 00000100:00100000:1.0:1779690671.552439:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866368 00000100:00100000:1.0:1779690671.552441:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866368 00000100:00100000:1.0:1779690671.552463:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 374 00000100:00100000:1.0:1779690671.552472:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503865984:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690671.552546:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503865984:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690671.552553:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 374 00000100:00100000:1.0:1779690671.552569:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 375 00000100:00100000:1.0:1779690671.552583:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503866368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690671.552608:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503866368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690671.552613:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 375 00000100:00100000:1.0:1779690671.552734:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866624 00000100:00100000:1.0:1779690671.552738:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866624 00000100:00100000:3.0:1779690671.552780:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3066 00000100:00100000:3.0:1779690671.552789:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503866496:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690671.552855:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503866496:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690671.552862:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3066 00000100:00100000:0.0:1779690671.554561:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3067 00000100:00100000:0.0:1779690671.554576:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503866240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690671.554622:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503866240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 53us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690671.554628:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3067 00000100:00080000:0.0:1779690671.555846:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690671.555852:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690671.555855:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690671.555959:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503865856 00000100:00100000:0.0:1779690671.555967:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503865856 00000100:00100000:0.0:1779690671.556005:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:0.0:1779690671.556013:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503865856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690671.556066:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503865856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690671.556074:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:2.0:1779690671.558930:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3068 00000100:00100000:2.0:1779690671.558949:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503866112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690671.558999:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3069 00000100:00100000:3.0:1779690671.559011:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503866624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690671.559035:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503866112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 93us (6841us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690671.559044:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3068 00000100:00100000:3.0:1779690671.559046:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503866624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (6807us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690671.559053:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3069 00010000:00010000:1.0:1779690671.564457:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690672.009028:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690672.009036:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690672.009106:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690672.009115:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690672.284657:0:76236:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690672.284665:0:76236:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690672.284729:0:76236:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690672.284737:0:76236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690672.586439:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690673.033184:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690673.033194:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690673.033236:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690673.033244:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690673.610780:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690673.915862:0:76287:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690673.915872:0:76287:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690673.915938:0:76287:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:1.0:1779690673.915944:0:76287:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690674.057014:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690674.057024:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690674.057077:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:2.0:1779690674.057087:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690674.121199:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492385280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690674.121266:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690674.121325:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492385408:0@lo:400:kworker.0 00000100:00100000:1.0:1779690674.121350:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492385536:0@lo:400:kworker.0 00000100:00100000:3.0:1779690674.121358:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690674.121392:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690674.121429:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690674.121437:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492385664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690674.121459:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690674.121495:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385280 00000100:00100000:0.0:1779690674.121497:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385536 00000100:00100000:1.0:1779690674.121502:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385280 00000100:00100000:0.0:1779690674.121503:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385536 00000100:00100000:1.0:1779690674.121556:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385664 00000100:00100000:1.0:1779690674.121559:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385664 00000100:00100000:0.0:1779690674.121565:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1779690674.121576:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690674.121580:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1779690674.121590:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492385280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690674.121619:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690674.121632:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492385536:12345-0@lo:400:kworker.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690674.121640:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1779690674.121685:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385408 00000100:00100000:0.0:1779690674.121689:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385408 00000100:00100000:0.0:1779690674.121712:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1779690674.121719:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492385408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.122483:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690674.122494:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492385792:0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.122527:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690674.122557:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385792 00000100:00100000:2.0:1779690674.122561:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385792 00000100:00100000:2.0:1779690674.122592:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1779690674.122598:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.122631:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492385792:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690674.122637:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1779690674.122671:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492385792:0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.122702:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1779690674.122709:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492385664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690674.122728:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690674.122764:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492385664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690674.122770:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1779690674.122834:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492385536:0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.122848:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690674.122855:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492385920:0@lo:400:kworker.0 00000100:00100000:1.0:1779690674.122858:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492385280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1266us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690674.122868:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:3.0:1779690674.123036:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492385280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690674.123397:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1779690674.123439:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690674.123439:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492385408:12345-0@lo:400:kworker.0 Request processed in 1718us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690674.123440:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492385664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1779690674.123445:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690674.123449:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690674.123461:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1779690674.123471:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492385920 00000100:00100000:2.0:1779690674.123476:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492385920 00000100:00100000:2.0:1779690674.123510:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1779690674.123517:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492385920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690674.123558:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492385408:0@lo:400:kworker.0 00000100:00100000:2.0:1779690674.123569:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492385920:12345-0@lo:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690674.123577:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1779690674.123630:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492385920:0@lo:400:kworker.0 00010000:00010000:1.0:1779690674.633052:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690675.082618:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690675.082628:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690675.082670:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:0.0:1779690675.082677:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690675.429217:0:76338:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690675.429226:0:76338:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690675.429297:0:76338:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:1.0:1779690675.429303:0:76338:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690675.656953:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690676.105045:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690676.105062:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690676.105104:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:0.0:1779690676.105117:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690676.676426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676534:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690676.676668:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867136 00000100:00100000:2.0:1779690676.676679:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867136 00000100:00100000:2.0:1779690676.676742:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867392 00000100:00100000:2.0:1779690676.676760:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867392 00000100:00100000:2.0:1779690676.676786:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867008 00000100:00100000:2.0:1779690676.676789:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867008 00000100:00100000:2.0:1779690676.676848:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867520 00000100:00100000:2.0:1779690676.676852:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867520 00000100:00100000:1.0:1779690676.676872:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866880 00000100:00100000:1.0:1779690676.676887:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866880 00000100:00100000:2.0:1779690676.676888:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3070 00000100:00100000:2.0:1779690676.676905:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503867136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690676.676967:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867264 00000100:00100000:1.0:1779690676.676971:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867264 00000100:00100000:2.0:1779690676.677003:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503867136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 102us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690676.677012:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3070 00000100:00100000:1.0:1779690676.677026:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 379 00000100:00100000:1.0:1779690676.677039:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503866880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690676.677053:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3071 00000100:00100000:2.0:1779690676.677061:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503867392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690676.677096:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503867392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690676.677102:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3071 00000100:00100000:2.0:1779690676.677116:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3072 00000100:00100000:2.0:1779690676.677122:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503867008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690676.677133:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503866880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 94us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690676.677143:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 379 00000100:00100000:2.0:1779690676.677155:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503867008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690676.677165:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3072 00000100:00100000:1.0:1779690676.677173:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 380 00000100:00100000:2.0:1779690676.677189:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3073 00000100:00100000:2.0:1779690676.677199:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503867520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690676.677223:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503867520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690676.677230:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3073 00000100:00100000:2.0:1779690676.677264:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503866752 00000100:00100000:2.0:1779690676.677268:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503866752 00000100:00100000:2.0:1779690676.677296:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00100000:2.0:1779690676.677302:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503866752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690676.677330:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503866752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690676.677336:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00080000:2.0:1779690676.677377:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690676.677382:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690676.677384:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690676.677409:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503867264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690676.677452:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503867264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 271us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690676.677461:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 380 00010000:00010000:3.0:1779690676.681297:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690676.991194:0:76389:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690676.991202:0:76389:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690676.991373:0:76389:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:3.0:1779690676.991379:0:76389:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690677.129057:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690677.129065:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690677.129102:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 8 00000040:00080000:0.0:1779690677.129109:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690677.707912:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690678.153560:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690678.153570:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690678.154065:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690678.154073:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690678.496611:0:76441:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690678.496619:0:76441:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690678.496683:0:76441:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:3.0:1779690678.496689:0:76441:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690678.728933:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690679.177037:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690679.177044:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690679.177081:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690679.177088:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690679.240979:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492386048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690679.240980:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492386304:0@lo:400:kworker.0 00000100:00100000:2.0:1779690679.241037:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492386176:0@lo:400:kworker.0 00000100:00100000:0.0:1779690679.241117:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492386432:0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241257:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690679.241318:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492386688:0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241342:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690679.241360:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690679.241366:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492386816:0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241389:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690679.241427:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386048 00000100:00100000:3.0:1779690679.241433:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386048 00000100:00100000:3.0:1779690679.241483:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1779690679.241492:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492386048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690679.241523:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690679.241566:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492386048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690679.241572:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1779690679.241628:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492386048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1779690679.241656:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690679.241674:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386816 00000100:00100000:3.0:1779690679.241677:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386816 00000100:00100000:3.0:1779690679.241708:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1779690679.241715:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492386816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241750:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492386816:12345-0@lo:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690679.241757:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1779690679.241781:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492386816:0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241849:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386688 00000100:00100000:3.0:1779690679.241853:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386688 00000100:00100000:3.0:1779690679.241884:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:3.0:1779690679.241890:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492386688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.241924:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492386688:12345-0@lo:400:kworker.0 Request processed in 35us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690679.241930:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00080000:3.0:1779690679.241943:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690679.242009:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492386688:0@lo:400:kworker.0 00000100:00100000:1.0:1779690679.246052:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690679.247947:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690679.248165:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492386560:0@lo:400:kworker.0 00000100:00100000:2.0:1779690679.248209:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690679.248246:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386304 00000100:00100000:3.0:1779690679.248254:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386304 00000100:00100000:2.0:1779690679.248266:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386560 00000100:00100000:2.0:1779690679.248271:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386560 00000100:00100000:2.0:1779690679.248313:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1779690679.248316:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1779690679.248326:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492386560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690679.248328:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492386304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690679.248391:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492386560:12345-0@lo:400:kworker.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690679.248400:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492386304:12345-0@lo:400:kworker.0 Request processed in 74us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690679.248402:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1779690679.248413:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1779690679.248450:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492386560:0@lo:400:kworker.0 00000100:00080000:3.0:1779690679.248451:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690679.248664:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492386304:0@lo:400:kworker.0 00000100:00100000:1.0:1779690679.248721:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386176 00000100:00100000:1.0:1779690679.248726:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386176 00000100:00100000:1.0:1779690679.248917:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1779690679.248926:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492386176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690679.248964:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492386176:12345-0@lo:400:kworker.0 Request processed in 41us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690679.248978:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1779690679.249066:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492386176:0@lo:400:kworker.0 00000100:00100000:0.0:1779690679.249073:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690679.249100:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492386944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690679.249123:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690679.249163:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386432 00000100:00100000:0.0:1779690679.249165:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492386944 00000100:00100000:3.0:1779690679.249168:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386432 00000100:00100000:0.0:1779690679.249170:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492386944 00000100:00100000:0.0:1779690679.249200:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1779690679.249208:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492386944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690679.249217:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1779690679.249226:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492386432:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1779690679.249234:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690679.249274:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492386432:12345-0@lo:400:kworker.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690679.249284:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1779690679.249284:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492386944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00080000:2.0:1779690679.249293:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690679.249295:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1779690679.249328:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492386432:0@lo:400:kworker.0 00000100:00100000:0.0:1779690679.249341:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492386944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1779690679.753350:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690679.980484:0:76494:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690679.980491:0:76494:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690679.980566:0:76494:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:3.0:1779690679.980571:0:76494:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690680.201352:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690680.201360:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690680.201405:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690680.201413:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690680.778421:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690681.225306:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690681.225315:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690681.225366:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690681.225374:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690681.470506:0:76545:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690681.470514:0:76545:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690681.470573:0:76545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:1.0:1779690681.470579:0:76545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690681.792685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792787:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792945:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.792998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690681.793027:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868160 00000100:00100000:1.0:1779690681.793035:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868160 00000100:00100000:1.0:1779690681.793090:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867776 00000100:00100000:1.0:1779690681.793093:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867776 00000100:00100000:1.0:1779690681.793114:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 384 00000100:00100000:1.0:1779690681.793124:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503868160:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793189:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503868160:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690681.793196:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 384 00000100:00100000:1.0:1779690681.793212:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 385 00000100:00100000:1.0:1779690681.793219:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503867776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793241:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503867776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690681.793247:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 385 00000100:00100000:0.0:1779690681.793343:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867904 00000100:00100000:0.0:1779690681.793349:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867904 00000100:00100000:0.0:1779690681.793382:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868416 00000100:00100000:0.0:1779690681.793386:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868416 00000100:00100000:0.0:1779690681.793408:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868032 00000100:00100000:0.0:1779690681.793411:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868032 00000100:00100000:1.0:1779690681.793421:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868288 00000100:00100000:1.0:1779690681.793427:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868288 00000100:00100000:0.0:1779690681.793441:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3076 00000100:00100000:0.0:1779690681.793451:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503867904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793474:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3077 00000100:00100000:1.0:1779690681.793482:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503868416:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793516:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503868416:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690681.793528:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3077 00000100:00100000:1.0:1779690681.793541:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3078 00000100:00100000:1.0:1779690681.793548:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503868032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793569:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503868032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690681.793575:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3078 00000100:00100000:1.0:1779690681.793587:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3079 00000100:00100000:1.0:1779690681.793593:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503868288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690681.793614:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503868288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690681.793620:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3079 00000100:00100000:0.0:1779690681.793645:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503867904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 195us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690681.793661:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3076 00000100:00080000:1.0:1779690681.793662:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690681.793667:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690681.793671:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690681.793950:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503867648 00000100:00100000:2.0:1779690681.793960:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503867648 00000100:00100000:2.0:1779690681.794007:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 243 00000100:00100000:2.0:1779690681.794014:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503867648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690681.794052:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503867648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690681.794059:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 243 00010000:00010000:2.0:1779690681.801094:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690682.250445:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690682.250454:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690682.250509:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690682.250516:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690682.825022:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690682.933023:0:76596:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690682.933030:0:76596:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690682.933088:0:76596:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690682.933095:0:76596:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690683.273049:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690683.273056:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690683.273109:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690683.273116:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690683.850473:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690684.297012:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690684.297021:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690684.297085:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000040:00080000:0.0:1779690684.297094:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690684.360939:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492387072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690684.361012:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690684.361099:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690684.361127:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690684.361166:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387072 00000100:00100000:1.0:1779690684.361180:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387072 00000100:00100000:1.0:1779690684.361264:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387200 00000100:00100000:1.0:1779690684.361277:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387200 00000100:00100000:1.0:1779690684.361313:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1779690684.361323:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492387072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690684.361355:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690684.361403:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492387072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690684.361410:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1779690684.361430:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1779690684.361437:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492387200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690684.361472:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690684.361507:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492387200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690684.361514:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00080000:1.0:1779690684.361535:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690684.361539:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690684.361573:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690684.361604:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492387072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690684.361970:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492387328:0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362003:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690684.362039:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387328 00000100:00100000:2.0:1779690684.362044:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387328 00000100:00100000:1.0:1779690684.362063:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690684.362072:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492387712:0@lo:400:kworker.0 00000100:00100000:2.0:1779690684.362087:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1779690684.362097:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492387328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362108:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690684.362150:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492387328:12345-0@lo:400:kworker.0 Request processed in 54us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690684.362150:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387712 00000100:00100000:1.0:1779690684.362156:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387712 00000100:00100000:2.0:1779690684.362159:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1779690684.362201:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1779690684.362210:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362246:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492387712:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690684.362252:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1779690684.362276:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492387456:0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362369:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690684.362396:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492387584:0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362421:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387456 00000100:00100000:1.0:1779690684.362426:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387456 00000100:00100000:2.0:1779690684.362430:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690684.362466:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387584 00000100:00100000:1.0:1779690684.362470:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387584 00000100:00100000:2.0:1779690684.362473:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1779690684.362484:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492387456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690684.362500:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1779690684.362510:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690684.362528:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492387456:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690684.362536:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1779690684.362559:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492387584:12345-0@lo:400:kworker.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690684.362566:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1779690684.362573:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492387456:0@lo:400:kworker.0 00000100:00080000:1.0:1779690684.362591:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690684.362610:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492387584:0@lo:400:kworker.0 00000040:00080000:3.0:1779690684.362625:0:76647:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690684.362630:0:76647:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690684.362692:0:76647:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 6 00000100:00100000:1.0:1779690684.362697:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492387712:0@lo:400:kworker.0 00000040:00080000:3.0:1779690684.362700:0:76647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690684.362715:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492387328:0@lo:400:kworker.0 00010000:00010000:2.0:1779690684.873119:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690685.321063:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690685.321072:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690685.322009:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 5 00000040:00080000:0.0:1779690685.322017:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690685.841736:0:76699:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690685.841744:0:76699:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690685.841792:0:76699:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 5 00000040:00080000:3.0:1779690685.841797:0:76699:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690685.896936:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690686.345137:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690686.345144:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690686.345181:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 5 00000040:00080000:0.0:1779690686.345187:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690686.913347:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690686.913394:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690686.913428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690686.913456:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868928 00000100:00100000:3.0:1779690686.913466:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868928 00000100:00100000:1.0:1779690686.913468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690686.913489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690686.913516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690686.913542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690686.913547:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868672 00000100:00100000:2.0:1779690686.913562:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868672 00000100:00100000:1.0:1779690686.913582:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869184 00000100:00100000:1.0:1779690686.913588:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869184 00000100:00100000:0.0:1779690686.913596:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868800 00000100:00100000:0.0:1779690686.913601:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868800 00000100:00100000:2.0:1779690686.913619:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869056 00000100:00100000:2.0:1779690686.913623:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869056 00000100:00100000:0.0:1779690686.913642:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869312 00000100:00100000:0.0:1779690686.913647:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869312 00000100:00100000:2.0:1779690686.913661:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 389 00000100:00100000:2.0:1779690686.913674:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503868672:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690686.913680:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3080 00000100:00100000:1.0:1779690686.913689:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3081 00000100:00100000:0.0:1779690686.913694:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503869184:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690686.913704:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503868800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690686.913757:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503868672:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690686.913765:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3082 00000100:00100000:2.0:1779690686.913768:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 389 00000100:00100000:3.0:1779690686.913777:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503869312:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690686.913790:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 390 00000100:00100000:2.0:1779690686.913798:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503869056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690686.916226:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503868800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2518us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690686.916239:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3081 00000100:00100000:1.0:1779690686.916271:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3083 00000100:00100000:1.0:1779690686.916283:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503868928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690686.916323:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503868928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690686.916330:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3083 00000100:00100000:1.0:1779690686.916421:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503868544 00000100:00100000:1.0:1779690686.916428:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503868544 00000100:00100000:1.0:1779690686.916466:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:1.0:1779690686.916473:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503868544:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690686.916499:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503868544:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690686.916505:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00080000:1.0:1779690686.916557:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690686.916563:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690686.916566:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690686.918007:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503869184:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4312us (4572us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690686.918018:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3080 00000100:00100000:3.0:1779690686.918403:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503869312:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4627us (4858us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690686.918412:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3082 00000100:00100000:2.0:1779690686.919590:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503869056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 5788us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690686.919603:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 390 00010000:00010000:3.0:1779690686.921437:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690687.324639:0:76750:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690687.324647:0:76750:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690687.324710:0:76750:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 5 00000040:00080000:2.0:1779690687.324718:0:76750:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690687.370064:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690687.370071:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690687.370112:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 5 00000040:00080000:2.0:1779690687.370120:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690687.945003:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690688.395275:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690688.395283:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690688.396143:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 2 00000040:00080000:2.0:1779690688.396152:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690688.856013:0:76801:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690688.856022:0:76801:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690688.856083:0:76801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 2 00000040:00080000:2.0:1779690688.856090:0:76801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690688.971988:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690689.417096:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690689.417103:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690689.417138:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 2 00000040:00080000:2.0:1779690689.417146:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690689.481868:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492387840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690689.482004:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690689.482026:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690689.482042:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492387968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690689.482077:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690689.482110:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387840 00000100:00100000:2.0:1779690689.482118:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387840 00000100:00100000:1.0:1779690689.482162:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492387968 00000100:00100000:1.0:1779690689.482166:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492387968 00000100:00100000:2.0:1779690689.482192:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1779690689.482199:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1779690689.482209:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492387968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690689.482215:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492387840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690689.482250:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00002000:00000024:1.0:1779690689.482252:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690689.482306:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492387840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690689.482308:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492387968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690689.482321:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1779690689.482368:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492387840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1779690689.482369:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690689.482377:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690689.482406:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492387968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690689.482429:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492388096:0@lo:400:kworker.0 00000100:00100000:0.0:1779690689.482465:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690689.482498:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492388480:0@lo:400:kworker.0 00000100:00100000:0.0:1779690689.482515:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388096 00000100:00100000:0.0:1779690689.482520:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388096 00000100:00100000:3.0:1779690689.482542:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690689.482556:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1779690689.482565:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492388096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690689.482570:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492388352:0@lo:400:kworker.0 00000100:00100000:3.0:1779690689.482586:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388480 00000100:00100000:3.0:1779690689.482591:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388480 00000100:00100000:0.0:1779690689.482614:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492388096:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690689.482615:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690689.482625:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1779690689.482633:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388352 00000100:00100000:3.0:1779690689.482638:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388352 00000100:00100000:2.0:1779690689.482648:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690689.482656:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492388224:0@lo:400:kworker.0 00000100:00100000:0.0:1779690689.482672:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492388096:0@lo:400:kworker.0 00000100:00100000:3.0:1779690689.482678:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1779690689.482689:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492388480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690689.482713:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1779690689.482723:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492388352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690689.482731:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492388480:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690689.482740:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:3.0:1779690689.482760:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690689.482774:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492388352:12345-0@lo:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690689.482781:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492388480:0@lo:400:kworker.0 00000100:00100000:0.0:1779690689.482782:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1779690689.482859:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690689.482903:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1779690689.482982:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492388352:0@lo:400:kworker.0 00000100:00100000:3.0:1779690689.483228:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388224 00000100:00100000:3.0:1779690689.483233:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388224 00000100:00100000:3.0:1779690689.483274:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1779690689.483281:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690689.483326:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492388224:12345-0@lo:400:kworker.0 Request processed in 45us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690689.483332:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1779690689.483404:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492388224:0@lo:400:kworker.0 00000100:00080000:0.0:1779690689.483784:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690689.993019:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690690.317012:0:76854:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690690.317024:0:76854:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690690.317071:0:76854:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 55 count 2 00000040:00080000:3.0:1779690690.317077:0:76854:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690690.441134:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690690.441152:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690690.441403:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 54 count 1 00000040:00080000:2.0:1779690690.441410:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690691.017097:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690691.466382:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690691.466389:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690691.466991:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690691.467002:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690691.825541:0:76905:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690691.825549:0:76905:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690691.826033:0:76905:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690691.826040:0:76905:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690692.037859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690692.037968:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690692.038001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690692.038025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690692.038079:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869440 00000100:00100000:2.0:1779690692.038088:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869440 00000100:00100000:2.0:1779690692.038133:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:2.0:1779690692.038143:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503869440:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690692.038201:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503869440:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690692.038208:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:3.0:1779690692.038410:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869696 00000100:00100000:3.0:1779690692.038415:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869696 00000100:00100000:3.0:1779690692.038462:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3084 00000100:00100000:3.0:1779690692.038469:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503869696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690692.038502:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503869696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690692.038509:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3084 00000100:00080000:2.0:1779690692.038654:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690692.040376:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869568 00000100:00100000:0.0:1779690692.040383:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869568 00000100:00100000:2.0:1779690692.040442:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869952 00000100:00100000:2.0:1779690692.040446:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869952 00000100:00100000:2.0:1779690692.040503:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 394 00000100:00100000:2.0:1779690692.040511:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503869952:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690692.040568:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503869952:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 57us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690692.040575:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 394 00000100:00100000:2.0:1779690692.040684:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 395 00000100:00100000:2.0:1779690692.040691:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503869568:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690692.040717:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503869568:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690692.040738:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 395 00000100:00080000:0.0:1779690692.040795:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690692.041002:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690692.043759:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690692.043846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690692.044053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690692.044139:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870208 00000100:00100000:2.0:1779690692.044147:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870208 00000100:00100000:2.0:1779690692.044225:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503869824 00000100:00100000:2.0:1779690692.044228:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503869824 00000100:00080000:0.0:1779690692.044265:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690692.044292:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3085 00000100:00100000:0.0:1779690692.044303:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503870208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690692.044360:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503870208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 59us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690692.044367:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3085 00000100:00100000:0.0:1779690692.044532:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870080 00000100:00100000:0.0:1779690692.044536:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870080 00000100:00100000:0.0:1779690692.044574:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3086 00000100:00100000:0.0:1779690692.044580:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503870080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690692.044610:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503870080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690692.044616:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3086 00000100:00080000:1.0:1779690692.044688:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690692.045109:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3087 00000100:00100000:2.0:1779690692.045118:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503869824:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690692.045154:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503869824:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690692.045161:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3087 00000040:00080000:0.0:1779690692.489349:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690692.489358:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690692.490659:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690692.490672:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690693.065988:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690693.310577:0:76957:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690693.310585:0:76957:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690693.311630:0:76957:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690693.311642:0:76957:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690693.513793:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690693.513801:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690693.514443:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690693.514454:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690694.089174:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690694.537084:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690694.537092:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690694.537690:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690694.537700:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690694.601508:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690694.601531:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492388608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690694.601595:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.601645:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388608 00000100:00100000:2.0:1779690694.601653:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388608 00000100:00100000:2.0:1779690694.601715:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1779690694.601724:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492388608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690694.601754:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690694.601798:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492388608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.601835:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1779690694.601900:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492388736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690694.601925:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.601954:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388736 00000100:00100000:2.0:1779690694.601965:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388736 00000100:00100000:2.0:1779690694.601988:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1779690694.601993:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492388736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690694.602010:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690694.602053:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492388736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.602058:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1779690694.602094:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492388736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690694.602131:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492388608:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1779690694.602254:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690694.602258:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690694.602355:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492389120:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602383:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.602404:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690694.602409:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492388992:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602430:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.602456:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389120 00000100:00100000:2.0:1779690694.602460:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389120 00000100:00100000:2.0:1779690694.602490:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388992 00000100:00100000:2.0:1779690694.602493:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388992 00000100:00100000:2.0:1779690694.602514:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1779690694.602520:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602552:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492389120:12345-0@lo:400:kworker.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.602557:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1779690694.602570:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1779690694.602576:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602599:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492388992:12345-0@lo:400:kworker.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.602611:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:2.0:1779690694.602633:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690694.602641:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492389248:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602663:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.602679:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690694.602683:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492388864:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602705:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690694.602732:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389248 00000100:00100000:2.0:1779690694.602735:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389248 00000100:00100000:2.0:1779690694.602754:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1779690694.602759:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602788:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492389248:12345-0@lo:400:kworker.0 Request processed in 28us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.602794:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1779690694.602829:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492388864 00000100:00100000:2.0:1779690694.602833:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492388864 00000100:00100000:2.0:1779690694.602853:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1779690694.602859:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492388864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602895:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492388864:12345-0@lo:400:kworker.0 Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690694.602901:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1779690694.602934:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492388992:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602943:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492389120:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602966:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492388864:0@lo:400:kworker.0 00000100:00100000:2.0:1779690694.602984:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492389248:0@lo:400:kworker.0 00000040:00080000:0.0:1779690694.818678:0:77011:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690694.818685:0:77011:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690694.819331:0:77011:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690694.819340:0:77011:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690695.113820:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690695.562636:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690695.562644:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690695.563349:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690695.563360:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690696.137904:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690696.422692:0:77062:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690696.422699:0:77062:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690696.423390:0:77062:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690696.423398:0:77062:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690696.585053:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690696.585061:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690696.585736:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690696.585748:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690697.153545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690697.153585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690697.153606:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870464 00000100:00100000:1.0:1779690697.153610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690697.153616:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870464 00000100:00100000:2.0:1779690697.153674:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 399 00000100:00100000:2.0:1779690697.153685:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503870464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690697.153755:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503870464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690697.153762:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 399 00000100:00080000:2.0:1779690697.153782:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690697.156517:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870720 00000100:00100000:3.0:1779690697.156529:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870720 00000100:00100000:3.0:1779690697.156588:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870976 00000100:00100000:3.0:1779690697.156592:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870976 00000100:00100000:3.0:1779690697.156621:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3088 00000100:00100000:3.0:1779690697.156631:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503870720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.156721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690697.156770:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690697.156796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690697.156840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690697.156876:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870336 00000100:00100000:1.0:1779690697.156893:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870336 00000100:00100000:1.0:1779690697.156924:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:1.0:1779690697.156932:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503870336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.156970:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308664a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503870336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690697.156976:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:1.0:1779690697.157006:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870592 00000100:00100000:1.0:1779690697.157009:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870592 00000100:00100000:1.0:1779690697.157031:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3089 00000100:00100000:1.0:1779690697.157038:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503870976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.157064:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503870976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690697.157069:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3089 00000100:00100000:1.0:1779690697.157082:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871104 00000100:00100000:1.0:1779690697.157084:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871104 00000100:00100000:1.0:1779690697.157103:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3090 00000100:00100000:1.0:1779690697.157108:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503870592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.157132:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503870592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690697.157138:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3090 00000100:00100000:1.0:1779690697.157148:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3091 00000100:00100000:1.0:1779690697.157154:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503871104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.157477:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503871104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 323us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690697.157485:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3091 00000100:00100000:1.0:1779690697.157514:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503870848 00000100:00100000:1.0:1779690697.157518:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503870848 00000100:00100000:1.0:1779690697.157548:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 400 00000100:00100000:1.0:1779690697.157555:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503870848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690697.157585:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503870848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690697.157591:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 400 00000100:00080000:1.0:1779690697.157648:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690697.157652:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690697.157653:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1779690697.161537:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690697.163541:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503870720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6901us (9945us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690697.163554:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3088 00000040:00080000:1.0:1779690697.612245:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690697.612258:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690697.612797:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690697.612850:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690698.032217:0:77113:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690698.032224:0:77113:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690698.032942:0:77113:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690698.032952:0:77113:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690698.186864:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690698.633145:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690698.633152:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690698.633663:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690698.633671:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690699.211975:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690699.564351:0:77165:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690699.564357:0:77165:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690699.564919:0:77165:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690699.564928:0:77165:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690699.659969:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690699.659978:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690699.660511:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690699.660520:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690699.721116:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690699.721152:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8276e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492389376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690699.721188:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690699.721221:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690699.721252:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690699.721363:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389376 00000100:00100000:2.0:1779690699.721369:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389376 00000100:00100000:0.0:1779690699.721426:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492389632:0@lo:400:kworker.0 00000100:00100000:0.0:1779690699.721511:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690699.721523:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389504 00000100:00100000:2.0:1779690699.721528:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389504 00000100:00100000:0.0:1779690699.721546:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690699.721554:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492390016:0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.721559:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1779690699.721570:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492389376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690699.721584:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1779690699.721604:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690699.721613:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389632 00000100:00100000:0.0:1779690699.721618:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389632 00000100:00100000:2.0:1779690699.721643:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492389376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690699.721648:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1779690699.721652:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1779690699.721658:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.721668:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1779690699.721675:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690699.721690:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690699.721698:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f87c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492389632:12345-0@lo:400:kworker.0 Request processed in 42us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690699.721705:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1779690699.721724:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690699.721731:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1779690699.721736:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390016 00000100:00100000:0.0:1779690699.721739:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390016 00000100:00100000:0.0:1779690699.721766:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1779690699.721772:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492390016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.721820:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492389760:0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.721853:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690699.721885:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8276e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492389376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690699.721885:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492390016:12345-0@lo:400:kworker.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690699.721896:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1779690699.721906:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690699.721910:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389760 00000100:00100000:0.0:1779690699.721914:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389760 00000100:00100000:2.0:1779690699.721915:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492389888:0@lo:400:kworker.0 00000100:00100000:0.0:1779690699.721940:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1779690699.721945:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690699.721948:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492389760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.721974:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492389888 00000100:00100000:2.0:1779690699.721978:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492389888 00000100:00100000:2.0:1779690699.722004:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1779690699.722010:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492389888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.722042:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8276e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492389888:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690699.722048:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1779690699.722073:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492389888:0@lo:400:kworker.0 00000100:00100000:0.0:1779690699.722208:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492389760:12345-0@lo:400:kworker.0 Request processed in 262us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690699.722214:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1779690699.722241:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492390016:0@lo:400:kworker.0 00000100:00100000:2.0:1779690699.722255:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492389760:0@lo:400:kworker.0 00000100:00100000:0.0:1779690699.722255:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492389632:0@lo:400:kworker.0 00000100:00080000:1.0:1779690699.722587:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690699.722591:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690699.722593:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690699.722610:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492389504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1779690700.233363:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690700.681074:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690700.681081:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690700.681605:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690700.681613:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690701.046736:0:77216:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690701.046743:0:77216:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690701.047697:0:77216:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690701.047708:0:77216:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690701.257762:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690701.705109:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690701.705117:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690701.707304:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690701.707321:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690702.279972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690702.280015:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690702.280033:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871232 00000100:00100000:2.0:1779690702.280043:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871232 00000100:00100000:1.0:1779690702.280092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690702.280101:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:2.0:1779690702.280113:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503871232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690702.280121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690702.280180:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503871232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690702.280189:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:0.0:1779690702.280326:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871744 00000100:00100000:0.0:1779690702.280330:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871744 00000100:00100000:0.0:1779690702.280371:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 404 00000100:00100000:0.0:1779690702.280378:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503871744:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690702.280414:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503871744:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690702.280421:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 404 00000100:00080000:2.0:1779690702.281852:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690702.282252:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1779690702.283749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690702.283782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690702.283850:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871360 00000100:00100000:3.0:1779690702.283854:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871488 00000100:00100000:2.0:1779690702.283860:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871360 00000100:00100000:3.0:1779690702.283861:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871488 00000100:00100000:3.0:1779690702.283921:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872000 00000100:00100000:3.0:1779690702.283925:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872000 00000100:00100000:2.0:1779690702.284045:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 405 00000100:00100000:1.0:1779690702.284051:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690702.284060:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503871360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690702.284074:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871616 00000100:00100000:1.0:1779690702.284078:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871616 00000100:00100000:1.0:1779690702.284103:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503871872 00000100:00100000:1.0:1779690702.284105:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503871872 00000100:00100000:1.0:1779690702.284126:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3092 00000100:00100000:2.0:1779690702.284132:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503871360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690702.284142:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 405 00000100:00100000:1.0:1779690702.284200:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503871488:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690702.284232:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503871488:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690702.284238:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3092 00000100:00100000:1.0:1779690702.284260:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3093 00000100:00100000:1.0:1779690702.284267:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503871616:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690702.284300:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503871616:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690702.284305:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3093 00000100:00100000:1.0:1779690702.284318:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3094 00000100:00100000:1.0:1779690702.284325:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503871872:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690702.284345:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503871872:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690702.284350:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3094 00000100:00080000:2.0:1779690702.287010:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690702.287019:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690702.287021:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690702.287399:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3095 00000100:00100000:3.0:1779690702.287412:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503872000:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690702.287635:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503872000:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 227us (7513us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690702.287644:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3095 00000040:00080000:2.0:1779690702.679142:0:77267:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690702.679149:0:77267:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690702.679681:0:77267:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690702.679691:0:77267:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690702.730035:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690702.730043:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690702.730614:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690702.730624:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690703.306642:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690703.753091:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690703.753098:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690703.753627:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690703.753635:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690704.240112:0:77318:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690704.240119:0:77318:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690704.240770:0:77318:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690704.240781:0:77318:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690704.330619:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690704.777145:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690704.777153:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690704.777696:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690704.777705:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690704.841033:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690704.841076:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492390272:0@lo:400:kworker.0 00000100:00100000:2.0:1779690704.841146:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492390400:0@lo:400:kworker.0 00000100:00100000:3.0:1779690704.841181:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690704.841666:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690704.841700:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690704.841747:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492390528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690704.841771:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390272 00000100:00100000:2.0:1779690704.841778:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690704.841780:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390272 00000100:00100000:2.0:1779690704.841843:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390400 00000100:00100000:2.0:1779690704.841848:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390400 00000100:00100000:2.0:1779690704.841888:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1779690704.841896:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690704.841940:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492390400:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690704.841946:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1779690704.841967:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390144 00000100:00100000:2.0:1779690704.841970:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390144 00000100:00100000:2.0:1779690704.841988:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390528 00000100:00100000:2.0:1779690704.842001:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390528 00000100:00100000:2.0:1779690704.842017:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1779690704.842023:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492390144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690704.842048:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690704.842219:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1779690704.842228:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492390272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690704.842266:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492390272:12345-0@lo:400:kworker.0 Request processed in 41us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690704.842279:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1779690704.842323:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492390272:0@lo:400:kworker.0 00000100:00100000:1.0:1779690704.842360:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1779690704.842368:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492390528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690704.842391:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690704.842435:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492390528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690704.842441:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:1.0:1779690704.842461:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690704.842465:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690704.842468:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690704.842491:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492390528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690704.842521:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492390400:0@lo:400:kworker.0 00000100:00100000:2.0:1779690704.843105:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492390144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1080us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690704.843113:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1779690704.843122:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492390656:0@lo:400:kworker.0 00000100:00100000:1.0:1779690704.843156:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690704.843183:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690704.843243:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492390784:0@lo:400:kworker.0 00000100:00100000:3.0:1779690704.843274:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690704.843446:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390656 00000100:00100000:0.0:1779690704.843451:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390656 00000100:00100000:0.0:1779690704.843587:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390784 00000100:00100000:0.0:1779690704.843591:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390784 00000100:00100000:0.0:1779690704.843610:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1779690704.843627:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690704.843695:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1779690704.843704:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690704.843742:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492390784:12345-0@lo:400:kworker.0 Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690704.843749:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1779690704.843785:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492390784:0@lo:400:kworker.0 00000100:00080000:3.0:1779690704.844061:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690704.846691:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492390656:12345-0@lo:400:kworker.0 Request processed in 3057us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690704.846704:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1779690704.847208:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492390656:0@lo:400:kworker.0 00010000:00010000:0.0:1779690705.353367:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690705.753790:0:77369:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690705.753839:0:77369:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690705.754535:0:77369:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690705.754545:0:77369:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690705.802129:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690705.802139:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690705.803518:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690705.803541:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690706.377555:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690706.825095:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690706.825108:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690706.825627:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690706.825640:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690707.363494:0:77421:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690707.363502:0:77421:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690707.364274:0:77421:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690707.364283:0:77421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690707.393948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690707.393994:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690707.394027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690707.394037:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872128 00000100:00100000:0.0:1779690707.394051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690707.394054:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872128 00000100:00100000:0.0:1779690707.394075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690707.394099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690707.394128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690707.394144:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 253 00000100:00100000:3.0:1779690707.394160:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503872128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690707.394165:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872640 00000100:00100000:0.0:1779690707.394175:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872640 00000100:00100000:0.0:1779690707.394237:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872256 00000100:00100000:0.0:1779690707.394240:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872256 00000100:00100000:0.0:1779690707.394268:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 409 00000100:00100000:0.0:1779690707.394278:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503872640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690707.394290:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503872128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690707.394357:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503872640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690707.394371:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 253 00000100:00100000:0.0:1779690707.394379:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 409 00000100:00100000:0.0:1779690707.394407:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 410 00000100:00100000:0.0:1779690707.394414:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503872256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690707.394439:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872384 00000100:00100000:0.0:1779690707.394445:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503872256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690707.394446:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872384 00000100:00100000:0.0:1779690707.394453:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 410 00000100:00100000:0.0:1779690707.394493:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872896 00000100:00100000:0.0:1779690707.394498:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872896 00000100:00100000:3.0:1779690707.394505:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872512 00000100:00100000:3.0:1779690707.394510:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872512 00000100:00100000:0.0:1779690707.394538:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503872768 00000100:00100000:0.0:1779690707.394544:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503872768 00000100:00100000:3.0:1779690707.394559:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3096 00000100:00100000:3.0:1779690707.394569:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503872384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690707.394588:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3097 00000100:00100000:0.0:1779690707.394598:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503872896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690707.394631:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503872384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 61us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690707.394640:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3096 00000100:00100000:0.0:1779690707.394649:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503872896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690707.394658:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3097 00000100:00100000:3.0:1779690707.394669:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3098 00000100:00100000:3.0:1779690707.394683:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503872512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690707.394693:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3099 00000100:00100000:0.0:1779690707.394706:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503872768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690707.394733:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503872512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 53us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690707.394743:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3098 00000100:00100000:0.0:1779690707.394751:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503872768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690707.394759:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3099 00000100:00080000:0.0:1779690707.394848:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690707.394854:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690707.394857:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1779690707.403891:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690707.849070:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690707.849077:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690707.849710:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690707.849718:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690708.428948:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690708.873157:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690708.873164:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690708.874227:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690708.874240:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690708.883554:0:77472:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690708.883562:0:77472:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690708.885014:0:77472:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690708.885027:0:77472:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690709.448959:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690709.897049:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690709.897058:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690709.897700:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690709.897710:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690709.961135:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1779690709.961156:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492390912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690709.961214:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690709.961327:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492391040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690709.961354:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690709.961440:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492391424:0@lo:400:kworker.0 00000100:00100000:3.0:1779690709.961459:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690709.961470:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1779690709.961473:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492391296:0@lo:400:kworker.0 00000100:00100000:0.0:1779690709.961500:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391424 00000100:00100000:3.0:1779690709.961501:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690709.961509:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391424 00000100:00100000:3.0:1779690709.961524:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391296 00000100:00100000:3.0:1779690709.961537:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391296 00000100:00100000:0.0:1779690709.961567:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1779690709.961577:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492391424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690709.961586:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492390912 00000100:00100000:2.0:1779690709.961593:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492390912 00000100:00100000:2.0:1779690709.961624:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391040 00000100:00100000:2.0:1779690709.961626:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391040 00000100:00100000:0.0:1779690709.961636:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492391424:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690709.961641:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1779690709.961650:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492390912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690709.961650:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1779690709.961675:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00002000:00000024:2.0:1779690709.961680:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690709.961691:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690709.961722:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492390912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690709.961730:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1779690709.961735:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492391296:12345-0@lo:400:kworker.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690709.961742:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1779690709.961748:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1779690709.961756:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492391040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690709.961830:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492391168:0@lo:400:kworker.0 00000100:00100000:1.0:1779690709.961855:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690709.961877:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690709.961882:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492391552:0@lo:400:kworker.0 00000100:00100000:1.0:1779690709.961904:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1779690709.961947:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690709.961970:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492391040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 217us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690709.961974:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1779690709.962005:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492390912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690709.962031:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492391296:0@lo:400:kworker.0 00000100:00100000:2.0:1779690709.962036:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492391424:0@lo:400:kworker.0 00000100:00100000:1.0:1779690709.962712:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391168 00000100:00100000:1.0:1779690709.962918:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391168 00000100:00100000:3.0:1779690709.962923:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391552 00000100:00100000:3.0:1779690709.962927:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391552 00000100:00100000:0.0:1779690709.962949:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1779690709.962954:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1779690709.962962:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690709.962966:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492391168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1779690709.962988:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690709.962993:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690709.962996:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690709.963023:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492391552:12345-0@lo:400:kworker.0 Request processed in 65us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690709.963025:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492391040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690709.963025:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492391168:12345-0@lo:400:kworker.0 Request processed in 63us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690709.963033:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1779690709.963072:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492391552:0@lo:400:kworker.0 00000100:00100000:1.0:1779690709.963081:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492391168:0@lo:400:kworker.0 00000100:00100000:0.0:1779690709.963363:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000040:00080000:0.0:1779690710.406999:0:77523:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690710.407006:0:77523:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690710.407630:0:77523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690710.407639:0:77523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690710.474062:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690710.921149:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690710.921157:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690710.921693:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690710.921703:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690711.498479:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690711.946390:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690711.946402:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690711.947037:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690711.947050:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690711.954411:0:77574:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690711.954425:0:77574:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690711.955036:0:77574:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690711.955048:0:77574:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690712.512011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690712.512048:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690712.512107:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873024 00000100:00100000:3.0:1779690712.512117:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873024 00000100:00100000:0.0:1779690712.512139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690712.512169:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:0.0:1779690712.512175:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690712.512184:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503873024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690712.512217:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873152 00000100:00100000:2.0:1779690712.512222:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873152 00000100:00100000:3.0:1779690712.512261:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503873024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690712.512269:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 414 00000100:00100000:3.0:1779690712.512272:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 255 00000100:00100000:2.0:1779690712.512281:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503873152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690712.512318:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503873152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (179us total) trans 0 rc 0/0 00000100:00080000:3.0:1779690712.512322:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690712.512326:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 414 00000100:00100000:0.0:1779690712.512493:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690712.512507:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873280 00000100:00100000:1.0:1779690712.512511:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873280 00000100:00100000:1.0:1779690712.512582:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873408 00000100:00100000:1.0:1779690712.512585:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873408 00000100:00100000:0.0:1779690712.512621:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873664 00000100:00100000:0.0:1779690712.512624:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873664 00000100:00080000:2.0:1779690712.512644:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690712.512647:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690712.512668:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3100 00000100:00100000:2.0:1779690712.512675:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503873280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690712.512709:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503873280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690712.512715:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3100 00000100:00100000:1.0:1779690712.512874:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3101 00000100:00100000:1.0:1779690712.512895:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503873408:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690712.512939:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503873408:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 57us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690712.512961:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3101 00000100:00100000:0.0:1779690712.513081:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3102 00000100:00100000:0.0:1779690712.513087:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503873664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690712.513122:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503873664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690712.513129:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3102 00000100:00100000:2.0:1779690712.514251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690712.514336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690712.514398:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873792 00000100:00100000:1.0:1779690712.514403:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873792 00000100:00100000:1.0:1779690712.514447:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3103 00000100:00100000:1.0:1779690712.514454:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503873792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690712.514490:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503873792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690712.514497:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3103 00000100:00080000:2.0:1779690712.514586:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690712.514666:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873536 00000100:00100000:0.0:1779690712.514670:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873536 00000100:00100000:0.0:1779690712.514740:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 415 00000100:00100000:0.0:1779690712.514758:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503873536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690712.514834:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503873536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690712.514841:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 415 00000100:00080000:2.0:1779690712.515060:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690712.521061:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690712.969079:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690712.969100:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690712.969911:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690712.969922:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690713.525466:0:77625:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690713.525473:0:77625:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690713.531267:0:77625:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690713.531287:0:77625:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690713.545964:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690713.993429:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690713.993620:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690713.994224:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690713.994235:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690714.569261:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690715.017133:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690715.017140:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690715.017615:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690715.017623:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690715.064509:0:77677:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690715.064521:0:77677:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690715.066825:0:77677:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690715.066914:0:77677:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690715.080954:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1779690715.080975:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f94fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690715.081038:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690715.081256:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391680 00000100:00100000:0.0:1779690715.081265:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391680 00000100:00100000:0.0:1779690715.081335:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1779690715.081350:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492391808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690715.081362:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492391680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690715.081385:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1779690715.081400:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690715.081422:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391808 00000100:00100000:2.0:1779690715.081427:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391808 00000100:00100000:0.0:1779690715.081458:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492391680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690715.081459:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1779690715.081472:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492391808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690715.081473:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00002000:00000024:2.0:1779690715.081497:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690715.081535:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492391808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690715.081542:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1779690715.081604:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f94fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690715.081626:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492391936:0@lo:400:kworker.0 00000100:00100000:3.0:1779690715.081634:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492392064:0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.081665:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690715.081678:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690715.081698:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690715.081705:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492392320:0@lo:400:kworker.0 00000100:00100000:3.0:1779690715.081709:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690715.081719:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492392192:0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.081747:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690715.081768:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392064 00000100:00100000:3.0:1779690715.081772:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392064 00000100:00100000:2.0:1779690715.081798:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492391936 00000100:00080000:1.0:1779690715.081800:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690715.081825:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690715.081827:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690715.081837:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492391936 00000100:00100000:1.0:1779690715.081859:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392320 00000100:00100000:1.0:1779690715.081865:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392320 00000100:00100000:2.0:1779690715.081871:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1779690715.081879:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492391936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690715.081914:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1779690715.081920:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492391936:12345-0@lo:400:kworker.0 Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690715.081926:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.081932:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1779690715.081983:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492391808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690715.081989:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3088325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492392064:12345-0@lo:400:kworker.0 Request processed in 65us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690715.082000:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1779690715.082016:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492391936:0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.082041:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690715.082063:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492392064:0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.082079:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392192 00000100:00100000:2.0:1779690715.082082:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392192 00000100:00100000:2.0:1779690715.082109:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1779690715.082115:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492392320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.082148:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492392320:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690715.082154:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1779690715.083707:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1779690715.083744:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492392192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.083816:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492392192:12345-0@lo:400:kworker.0 Request processed in 65us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690715.083824:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00080000:2.0:1779690715.083845:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690715.083869:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492392320:0@lo:400:kworker.0 00000100:00100000:2.0:1779690715.083893:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492392192:0@lo:400:kworker.0 00010000:00010000:2.0:1779690715.592955:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690716.041374:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690716.041387:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690716.041957:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690716.041970:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690716.548646:0:77728:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690716.548654:0:77728:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690716.549291:0:77728:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690716.549301:0:77728:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690716.619380:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690717.065336:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690717.065345:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690717.065947:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690717.065957:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690717.634381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634455:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634518:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690717.634573:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874176 00000100:00100000:1.0:1779690717.634581:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874176 00000100:00100000:1.0:1779690717.634639:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874688 00000100:00100000:1.0:1779690717.634642:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874688 00000100:00100000:1.0:1779690717.634659:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874304 00000100:00100000:1.0:1779690717.634662:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874304 00000100:00100000:1.0:1779690717.634677:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874560 00000100:00100000:1.0:1779690717.634679:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874560 00000100:00100000:1.0:1779690717.634697:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3104 00000100:00100000:1.0:1779690717.634716:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503874176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.634777:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503874176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.634784:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3104 00000100:00100000:1.0:1779690717.634800:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3105 00000100:00100000:1.0:1779690717.634847:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503874688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.634872:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503874688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.634892:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3105 00000100:00100000:1.0:1779690717.634905:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3106 00000100:00100000:1.0:1779690717.634911:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503874304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.634934:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503874304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.634939:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3106 00000100:00100000:1.0:1779690717.634950:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3107 00000100:00100000:1.0:1779690717.634955:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503874560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.634972:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503874560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 17us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.634978:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3107 00000100:00100000:1.0:1779690717.634995:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874432 00000100:00100000:1.0:1779690717.634998:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874432 00000100:00100000:1.0:1779690717.635021:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874048 00000100:00100000:1.0:1779690717.635023:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874048 00000100:00100000:1.0:1779690717.635039:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 419 00000100:00100000:1.0:1779690717.635044:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503874432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.635067:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503874432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.635073:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 419 00000100:00100000:1.0:1779690717.635082:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 420 00000100:00100000:1.0:1779690717.635087:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503874048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690717.635103:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503874048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 16us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690717.635114:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 420 00000100:00080000:2.0:1779690717.636343:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690717.636348:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690717.636350:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690717.636478:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503873920 00000100:00100000:3.0:1779690717.636484:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503873920 00000100:00100000:3.0:1779690717.636561:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 257 00000100:00100000:3.0:1779690717.636569:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503873920:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690717.636626:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503873920:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 58us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690717.636643:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 257 00010000:00010000:2.0:1779690717.640926:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690718.074443:0:77779:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690718.074451:0:77779:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690718.075132:0:77779:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690718.075142:0:77779:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690718.095056:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690718.095063:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690718.095726:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690718.095734:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690718.664971:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690719.114101:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690719.114109:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690719.114655:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690719.114664:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690719.564352:0:77830:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690719.564359:0:77830:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690719.565184:0:77830:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690719.565192:0:77830:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690719.688904:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690720.137034:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690720.137042:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690720.139177:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690720.139192:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690720.201005:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690720.201072:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690720.201260:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690720.201270:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690720.201298:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690720.201329:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392448 00000100:00100000:1.0:1779690720.201335:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392448 00000100:00100000:1.0:1779690720.201381:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392576 00000100:00100000:1.0:1779690720.201384:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392576 00000100:00100000:1.0:1779690720.201402:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1779690720.201411:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690720.201445:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690720.201486:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690720.201494:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1779690720.201512:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1779690720.201520:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492392576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690720.201552:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690720.201597:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492392576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690720.201603:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1779690720.201640:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492392576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1779690720.201642:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690720.201649:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690720.201698:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690720.201877:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492392832:0@lo:400:kworker.0 00000100:00100000:2.0:1779690720.201897:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492393088:0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.201911:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690720.201954:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492392960:0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.202008:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690720.202121:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690720.202122:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690720.202130:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ce11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492392704:0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.202162:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690720.202210:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392704 00000100:00100000:3.0:1779690720.202214:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392704 00000100:00100000:3.0:1779690720.202246:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1779690720.202255:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492392704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.202293:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492392704:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690720.202304:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1779690720.202348:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ce11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492392704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690720.203198:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392832 00000100:00100000:0.0:1779690720.203204:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392832 00000100:00080000:2.0:1779690720.203317:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690720.203618:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393088 00000100:00100000:0.0:1779690720.203633:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492392960 00000100:00100000:1.0:1779690720.203634:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393088 00000100:00100000:0.0:1779690720.203639:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492392960 00000100:00100000:3.0:1779690720.203718:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1779690720.203727:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492392832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.203776:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492392832:12345-0@lo:400:kworker.0 Request processed in 51us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690720.203790:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1779690720.203831:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1779690720.203837:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492393088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.203871:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492393088:12345-0@lo:400:kworker.0 Request processed in 35us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690720.203877:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1779690720.203889:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1779690720.203895:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492392960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.203927:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492392960:12345-0@lo:400:kworker.0 Request processed in 32us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690720.203933:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1779690720.203964:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492392832:0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.203989:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492393088:0@lo:400:kworker.0 00000100:00100000:3.0:1779690720.204017:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492392960:0@lo:400:kworker.0 00000100:00080000:3.0:1779690720.204036:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690720.713936:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690721.084347:0:77882:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690721.084353:0:77882:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690721.084911:0:77882:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690721.084920:0:77882:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690721.161003:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690721.161011:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690721.162346:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690721.162357:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690721.737885:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690722.186964:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690722.186971:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690722.188060:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690722.188071:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690722.604992:0:77933:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690722.605001:0:77933:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690722.605518:0:77933:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690722.605527:0:77933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690722.755929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690722.755967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.756102:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874816 00000100:00100000:0.0:1779690722.756112:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874816 00000100:00100000:0.0:1779690722.756161:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 259 00000100:00100000:0.0:1779690722.756171:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503874816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690722.756240:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfe10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503874816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690722.756247:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 259 00000100:00100000:2.0:1779690722.756437:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503874944 00000100:00100000:2.0:1779690722.756442:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503874944 00000100:00100000:2.0:1779690722.756493:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 424 00000100:00100000:2.0:1779690722.756503:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503874944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690722.756541:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503874944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690722.756548:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 424 00000100:00080000:3.0:1779690722.756637:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690722.757092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.757117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.757139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.757158:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.757183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690722.757205:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875072 00000100:00100000:0.0:1779690722.757209:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875072 00000100:00100000:0.0:1779690722.757237:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875200 00000100:00100000:0.0:1779690722.757240:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875200 00000100:00100000:0.0:1779690722.757256:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875456 00000100:00100000:0.0:1779690722.757259:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875456 00000100:00100000:0.0:1779690722.757276:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875584 00000100:00100000:0.0:1779690722.757279:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875584 00000100:00100000:0.0:1779690722.757297:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3108 00000100:00100000:0.0:1779690722.757305:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503875072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690722.757342:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503875072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690722.757350:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3108 00000100:00100000:0.0:1779690722.757361:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3109 00000100:00100000:0.0:1779690722.757367:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503875200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690722.757388:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503875200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690722.757394:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3109 00000100:00100000:0.0:1779690722.757405:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3110 00000100:00100000:0.0:1779690722.757411:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503875456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690722.757434:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503875456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690722.757440:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3110 00000100:00100000:0.0:1779690722.757450:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3111 00000100:00100000:0.0:1779690722.757456:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503875584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690722.757477:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503875584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690722.757484:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3111 00000100:00100000:2.0:1779690722.760861:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875328 00000100:00100000:2.0:1779690722.760871:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875328 00000100:00100000:2.0:1779690722.760931:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 425 00000100:00100000:2.0:1779690722.760941:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503875328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690722.761009:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503875328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690722.761017:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 425 00000100:00080000:1.0:1779690722.761995:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690722.761999:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690722.762003:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1779690722.762332:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690723.209196:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690723.209204:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690723.212162:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690723.212177:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690723.786186:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690724.125903:0:77984:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690724.125911:0:77984:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690724.126755:0:77984:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690724.126765:0:77984:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690724.236483:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690724.236488:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690724.237269:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690724.237278:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690724.809193:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690725.257367:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690725.257376:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690725.258660:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690725.258670:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690725.323155:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492393600:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323216:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.323282:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1779690725.323290:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492393216:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323320:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.323349:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492393728:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323372:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690725.323380:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492393472:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323402:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393600 00000100:00100000:3.0:1779690725.323410:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393600 00000100:00100000:1.0:1779690725.323420:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690725.323444:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1779690725.323452:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492393344:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323460:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393728 00000100:00100000:3.0:1779690725.323464:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393728 00000100:00100000:1.0:1779690725.323481:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.323487:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:3.0:1779690725.323496:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492393600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690725.323500:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492393856:0@lo:400:kworker.0 00000100:00100000:1.0:1779690725.323521:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.323556:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492393600:12345-0@lo:400:kworker.0 Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690725.323564:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00080000:1.0:1779690725.323567:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690725.323572:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690725.323584:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:3.0:1779690725.323592:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492393728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690725.323600:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393216 00000100:00100000:1.0:1779690725.323605:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393216 00000100:00100000:3.0:1779690725.323619:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492393728:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690725.323625:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:1.0:1779690725.323659:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1779690725.323670:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492393216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323688:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492393728:0@lo:400:kworker.0 00000100:00100000:3.0:1779690725.323702:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492393600:0@lo:400:kworker.0 00000100:00100000:1.0:1779690725.323709:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492393216:12345-0@lo:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690725.323718:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1779690725.323727:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492393216:0@lo:400:kworker.0 00000100:00100000:1.0:1779690725.323982:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690725.324008:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.324178:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393984 00000100:00100000:3.0:1779690725.324183:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393984 00000100:00100000:3.0:1779690725.324228:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1779690725.324235:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492393984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690725.324269:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690725.324308:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492393984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690725.324314:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1779690725.324350:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690725.324368:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492394112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690725.324391:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690725.324417:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394112 00000100:00100000:3.0:1779690725.324420:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394112 00000100:00100000:3.0:1779690725.324440:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1779690725.324446:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492394112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1779690725.324463:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690725.324494:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492394112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690725.324499:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1779690725.324530:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492394112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690725.324660:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393472 00000100:00100000:2.0:1779690725.324665:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393472 00000100:00100000:2.0:1779690725.324796:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393344 00000100:00100000:2.0:1779690725.324800:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393344 00000100:00100000:2.0:1779690725.324848:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492393856 00000100:00100000:2.0:1779690725.324852:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492393856 00000100:00100000:2.0:1779690725.324870:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1779690725.324877:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492393472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690725.324920:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492393472:12345-0@lo:400:kworker.0 Request processed in 44us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690725.324927:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1779690725.324942:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1779690725.324949:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492393344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690725.324976:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492393344:12345-0@lo:400:kworker.0 Request processed in 29us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690725.324983:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1779690725.324994:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1779690725.325000:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690725.325022:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492393856:12345-0@lo:400:kworker.0 Request processed in 24us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690725.325027:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00080000:2.0:1779690725.325065:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690725.325086:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492393344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690725.325097:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492393856:0@lo:400:kworker.0 00000100:00100000:2.0:1779690725.325106:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492393472:0@lo:400:kworker.0 00000040:00080000:0.0:1779690725.749587:0:78035:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690725.749598:0:78035:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690725.750169:0:78035:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690725.750181:0:78035:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690725.835157:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690726.281143:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690726.281162:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690726.281701:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690726.281712:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690726.857154:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690727.305651:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690727.305659:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690727.306154:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690727.306164:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690727.311357:0:78086:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690727.311364:0:78086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690727.313568:0:78086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690727.313580:0:78086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690727.876463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690727.876509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690727.876607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690727.876647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690727.876678:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876224 00000100:00100000:2.0:1779690727.876688:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876224 00000100:00100000:0.0:1779690727.876701:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875712 00000100:00100000:0.0:1779690727.876707:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875712 00000100:00100000:2.0:1779690727.876756:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 429 00000100:00100000:0.0:1779690727.876762:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 261 00000100:00100000:2.0:1779690727.876769:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503876224:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690727.876775:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503875712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690727.876873:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503875712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690727.876880:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 261 00000100:00100000:2.0:1779690727.878452:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503876224:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1685us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690727.878461:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 429 00000100:00080000:2.0:1779690727.878486:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690727.879297:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690727.879321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690727.879385:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875840 00000100:00100000:0.0:1779690727.879392:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875840 00000100:00100000:0.0:1779690727.879436:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 430 00000100:00100000:0.0:1779690727.879444:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503875840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690727.879491:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503875840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690727.879498:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 430 00000100:00080000:0.0:1779690727.879518:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690727.880459:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503875968 00000100:00100000:1.0:1779690727.880472:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503875968 00000100:00100000:1.0:1779690727.880517:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876480 00000100:00100000:1.0:1779690727.880520:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876480 00000100:00100000:1.0:1779690727.880541:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3114 00000100:00100000:1.0:1779690727.880559:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503875968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690727.880598:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503875968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690727.880605:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3114 00000100:00100000:1.0:1779690727.880619:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3115 00000100:00100000:1.0:1779690727.880636:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503876480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690727.880662:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503876480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690727.880668:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3115 00000100:00080000:0.0:1779690727.880799:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690727.880814:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1779690727.885998:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1779690727.886394:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690727.886584:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876096 00000100:00100000:2.0:1779690727.886593:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876096 00000100:00100000:2.0:1779690727.886648:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876352 00000100:00100000:2.0:1779690727.886651:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876352 00000100:00100000:2.0:1779690727.886672:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3116 00000100:00100000:2.0:1779690727.886681:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503876096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1779690727.886700:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690727.886706:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690727.886751:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503876096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690727.886759:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3116 00000100:00100000:2.0:1779690727.886773:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3117 00000100:00100000:2.0:1779690727.886779:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503876352:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690727.886798:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+19:2390:x1866137503876352:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 19us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690727.886826:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3117 00000040:00080000:2.0:1779690728.329186:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690728.329196:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690728.330107:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690728.330119:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690728.890606:0:78138:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690728.890614:0:78138:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690728.891442:0:78138:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690728.891451:0:78138:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690728.905665:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690729.353127:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690729.353138:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690729.357463:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690729.357482:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690729.929047:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690730.377213:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690730.377227:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690730.377884:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690730.377896:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690730.421641:0:78189:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690730.421653:0:78189:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690730.424481:0:78189:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690730.424505:0:78189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690730.441965:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690730.442017:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492394368:0@lo:400:kworker.0 00000100:00100000:0.0:1779690730.442069:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690730.442121:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690730.442139:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492394880:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442163:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492394752:0@lo:400:kworker.0 00000100:00100000:0.0:1779690730.442171:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690730.442198:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690730.442198:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1779690730.442206:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492394496:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442223:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690730.442231:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492394624:0@lo:400:kworker.0 00000100:00100000:0.0:1779690730.442244:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690730.442269:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492395008:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442276:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690730.442303:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690730.442334:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394240 00000100:00100000:2.0:1779690730.442343:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394240 00000100:00100000:0.0:1779690730.442344:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394368 00000100:00100000:0.0:1779690730.442350:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394368 00000100:00100000:0.0:1779690730.442409:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1779690730.442410:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1779690730.442426:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492394240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690730.442426:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492394368:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1779690730.442474:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690730.442487:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492394368:12345-0@lo:400:kworker.0 Request processed in 67us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690730.442496:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1779690730.442521:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492394240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442528:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1779690730.442534:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394880 00000100:00100000:0.0:1779690730.442539:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394880 00000100:00100000:2.0:1779690730.442558:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394496 00000100:00100000:2.0:1779690730.442563:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394496 00000100:00100000:0.0:1779690730.442568:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394752 00000100:00100000:0.0:1779690730.442572:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394752 00000100:00100000:2.0:1779690730.442598:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492394624 00000100:00100000:2.0:1779690730.442602:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492394624 00000100:00100000:0.0:1779690730.442619:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:0.0:1779690730.442629:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492394880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442642:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395008 00000100:00100000:2.0:1779690730.442646:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395008 00000100:00100000:2.0:1779690730.442667:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1779690730.442672:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492394880:12345-0@lo:400:kworker.0 Request processed in 44us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442678:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492394496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690730.442684:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:0.0:1779690730.442701:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:0.0:1779690730.442710:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492394752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442719:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492394496:12345-0@lo:400:kworker.0 Request processed in 43us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442726:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1779690730.442742:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1779690730.442751:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492394624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690730.442751:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492394752:12345-0@lo:400:kworker.0 Request processed in 42us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442783:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492394624:12345-0@lo:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442788:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1779690730.442798:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1779690730.442802:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442856:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492395008:12345-0@lo:400:kworker.0 Request processed in 53us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690730.442863:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00080000:2.0:1779690730.442889:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690730.442895:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690730.442897:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690730.442954:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492394624:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442966:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492394752:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.442983:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690730.443305:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492394496:0@lo:400:kworker.0 00000100:00100000:3.0:1779690730.443320:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492395008:0@lo:400:kworker.0 00000100:00100000:3.0:1779690730.443332:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492394368:0@lo:400:kworker.0 00000100:00100000:3.0:1779690730.443348:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492394880:0@lo:400:kworker.0 00000100:00100000:2.0:1779690730.443487:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1779690730.443499:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492395136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690730.443531:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690730.443591:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:1.0:1779690730.443638:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395136 00000100:00100000:1.0:1779690730.443643:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395136 00000100:00100000:1.0:1779690730.443707:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1779690730.443716:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492395136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690730.443743:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690730.443784:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492395136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690730.443790:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1779690730.443904:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492395136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1779690730.953007:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690731.401153:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690731.401162:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690731.403079:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690731.403095:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690731.978084:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690732.007012:0:78240:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690732.007024:0:78240:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690732.007572:0:78240:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690732.007584:0:78240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690732.425077:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690732.425085:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690732.425691:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690732.425702:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690732.993181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993355:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690732.993418:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876864 00000100:00100000:0.0:1779690732.993426:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876864 00000100:00100000:0.0:1779690732.993475:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877376 00000100:00100000:0.0:1779690732.993478:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877376 00000100:00100000:0.0:1779690732.993510:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876992 00000100:00100000:0.0:1779690732.993513:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876992 00000100:00100000:0.0:1779690732.993546:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877248 00000100:00100000:0.0:1779690732.993549:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877248 00000100:00100000:0.0:1779690732.993572:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3120 00000100:00100000:0.0:1779690732.993581:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503876864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690732.993660:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503876864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690732.993681:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3120 00000100:00100000:0.0:1779690732.993698:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3121 00000100:00100000:0.0:1779690732.993704:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503877376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690732.993730:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503877376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690732.993737:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3121 00000100:00100000:0.0:1779690732.993749:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3122 00000100:00100000:0.0:1779690732.993754:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503876992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690732.993775:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503876992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690732.993781:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3122 00000100:00100000:0.0:1779690732.993791:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3123 00000100:00100000:0.0:1779690732.993796:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503877248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690732.993846:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+19:2389:x1866137503877248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690732.993852:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3123 00000100:00100000:1.0:1779690732.994286:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877120 00000100:00100000:1.0:1779690732.994291:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877120 00000100:00100000:1.0:1779690732.994337:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876736 00000100:00100000:1.0:1779690732.994340:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876736 00000100:00100000:1.0:1779690732.994359:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 434 00000100:00100000:1.0:1779690732.994365:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503877120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690732.994400:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503877120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690732.994406:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 434 00000100:00100000:1.0:1779690732.994418:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 435 00000100:00100000:1.0:1779690732.994424:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503876736:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690732.994442:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503876736:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690732.994448:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 435 00000100:00080000:2.0:1779690732.995442:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690732.995450:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690732.995452:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690732.997293:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503876608 00000100:00100000:3.0:1779690732.997305:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503876608 00000100:00100000:3.0:1779690732.997416:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 263 00000100:00100000:3.0:1779690732.997425:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503876608:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690732.997502:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503876608:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 78us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690732.997510:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 263 00010000:00010000:0.0:1779690733.001350:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690733.451381:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690733.451388:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690733.451964:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690733.451976:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690733.509356:0:78291:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690733.509362:0:78291:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690733.509755:0:78291:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690733.509761:0:78291:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690734.027837:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690734.473058:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690734.473067:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690734.473634:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690734.473653:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690734.939782:0:78343:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690734.939788:0:78343:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690734.940282:0:78343:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690734.940292:0:78343:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690735.049930:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690735.497116:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690735.497130:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690735.497681:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690735.497696:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690735.561033:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492395648:0@lo:400:kworker.0 00000100:00100000:3.0:1779690735.561047:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492395264:0@lo:400:kworker.0 00000100:00100000:2.0:1779690735.561047:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492395392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690735.561095:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b4846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492395520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690735.561154:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690735.561166:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690735.561204:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395392 00000100:00100000:0.0:1779690735.561212:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395392 00000100:00100000:2.0:1779690735.561284:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492395904:0@lo:400:kworker.0 00000100:00100000:3.0:1779690735.561288:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492395776:0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561300:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1779690735.561320:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492395392:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690735.561331:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690735.561346:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395264 00000100:00100000:3.0:1779690735.561354:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395264 00002000:00000024:0.0:1779690735.561356:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690735.561411:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395904 00000100:00100000:3.0:1779690735.561414:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1779690735.561418:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395904 00000100:00100000:3.0:1779690735.561429:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492395264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561440:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492395392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690735.561457:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1779690735.561459:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690735.561486:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1779690735.561497:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492395904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561515:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690735.561523:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492395264:12345-0@lo:400:kworker.0 Request processed in 98us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690735.561537:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492396160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561554:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492396032:0@lo:400:kworker.0 00000100:00100000:2.0:1779690735.561561:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492395904:12345-0@lo:400:kworker.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690735.561579:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1779690735.561595:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:0.0:1779690735.561618:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1779690735.561626:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690735.561669:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690735.561686:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492395392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690735.561698:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395520 00000100:00100000:0.0:1779690735.561705:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395520 00000100:00100000:1.0:1779690735.561706:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395648 00000100:00100000:1.0:1779690735.561714:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395648 00000100:00100000:2.0:1779690735.561719:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492395904:0@lo:400:kworker.0 00000100:00100000:3.0:1779690735.561757:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492395264:0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561774:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1779690735.561784:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492395520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690735.561798:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492395776 00000100:00100000:2.0:1779690735.561836:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1779690735.561851:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492395648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690735.561856:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492395776 00002000:00000024:0.0:1779690735.561862:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690735.561872:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690735.561903:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396160 00000100:00100000:1.0:1779690735.561909:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396160 00000100:00100000:2.0:1779690735.561934:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492395648:12345-0@lo:400:kworker.0 Request processed in 87us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690735.561941:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1779690735.561948:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492395648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690735.561949:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1779690735.561962:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492395776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.561965:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492395520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690735.561977:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1779690735.561999:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1779690735.562013:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.562023:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396032 00000100:00100000:0.0:1779690735.562028:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396032 00000100:00080000:3.0:1779690735.562048:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690735.562056:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690735.562067:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492395776:12345-0@lo:400:kworker.0 Request processed in 113us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690735.562079:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1779690735.562093:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1779690735.562095:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492396032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690735.562103:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492396160:12345-0@lo:400:kworker.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690735.562116:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1779690735.562119:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492396160:0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.562170:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492396032:12345-0@lo:400:kworker.0 Request processed in 83us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690735.562178:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1779690735.562192:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492395776:0@lo:400:kworker.0 00000100:00100000:0.0:1779690735.562227:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b4846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492395520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690735.562237:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492396032:0@lo:400:kworker.0 00010000:00010000:0.0:1779690736.080594:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690736.392610:0:78395:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690736.392617:0:78395:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690736.394954:0:78395:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690736.394967:0:78395:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690736.521006:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690736.521015:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690736.521882:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690736.521894:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690737.097008:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690737.545128:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690737.545135:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690737.548579:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690737.548597:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690737.897329:0:78446:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690737.897336:0:78446:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690737.898867:0:78446:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690737.898879:0:78446:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690738.112120:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690738.112189:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877632 00000100:00100000:3.0:1779690738.112198:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877632 00000100:00100000:3.0:1779690738.112275:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 439 00000100:00100000:3.0:1779690738.112286:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503877632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690738.112355:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503877632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690738.112362:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 439 00000100:00080000:2.0:1779690738.112531:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690738.118731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690738.118777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690738.118829:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877504 00000100:00100000:2.0:1779690738.118839:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877504 00000100:00100000:0.0:1779690738.118860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690738.118885:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 265 00000100:00100000:0.0:1779690738.118891:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690738.118898:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503877504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690738.118923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690738.118937:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877888 00000100:00100000:1.0:1779690738.118943:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877888 00000100:00100000:2.0:1779690738.118960:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503877504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690738.118969:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 265 00000100:00100000:3.0:1779690738.118988:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878144 00000100:00100000:3.0:1779690738.118994:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878144 00000100:00100000:1.0:1779690738.118996:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503877760 00000100:00100000:1.0:1779690738.119000:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503877760 00000100:00080000:2.0:1779690738.119003:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690738.119008:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690738.119037:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3126 00000100:00100000:1.0:1779690738.119045:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3127 00000100:00100000:3.0:1779690738.119051:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503877888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690738.119059:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503878144:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690738.119837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690738.119864:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878272 00000100:00100000:0.0:1779690738.119869:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878272 00000100:00100000:0.0:1779690738.119908:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3128 00000100:00100000:0.0:1779690738.119915:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503877760:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690738.121408:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503877760:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1486us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690738.121418:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3128 00000100:00100000:0.0:1779690738.121444:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3129 00000100:00100000:0.0:1779690738.121453:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503878272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690738.121483:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503878272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690738.121504:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3129 00000100:00100000:0.0:1779690738.121567:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878016 00000100:00100000:0.0:1779690738.121574:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878016 00000100:00100000:0.0:1779690738.121610:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 440 00000100:00100000:0.0:1779690738.121617:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503878016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690738.121648:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503878016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690738.122750:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 440 00000100:00080000:0.0:1779690738.122828:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690738.122833:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690738.123984:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503877888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 4935us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690738.124062:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3126 00000100:00100000:1.0:1779690738.124198:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503878144:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 5139us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690738.124208:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3127 00010000:00010000:2.0:1779690738.125092:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690738.569112:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690738.569119:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690738.569746:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690738.569757:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690739.146498:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690739.417755:0:78497:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690739.417764:0:78497:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690739.418434:0:78497:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690739.418443:0:78497:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690739.593721:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690739.593730:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690739.594320:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690739.594330:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690740.169290:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690740.616987:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690740.616995:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690740.617635:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690740.617645:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690740.681946:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492396416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690740.681971:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492396672:0@lo:400:kworker.0 00000100:00100000:3.0:1779690740.682040:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492396288:0@lo:400:kworker.0 00000100:00100000:2.0:1779690740.682237:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492396544:0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.682313:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690740.682322:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690740.682376:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492397184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690740.682403:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492396928:0@lo:400:kworker.0 00000100:00100000:1.0:1779690740.682404:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690740.682439:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690740.682443:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396672 00000100:00100000:1.0:1779690740.682449:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396672 00000100:00100000:0.0:1779690740.682486:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396416 00000100:00100000:0.0:1779690740.682495:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396416 00000100:00100000:1.0:1779690740.682506:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1779690740.682518:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492396672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.682545:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397184 00000100:00100000:0.0:1779690740.682549:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397184 00000100:00100000:0.0:1779690740.682574:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1779690740.682582:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492396416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690740.682597:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690740.682598:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492396672:12345-0@lo:400:kworker.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690740.682608:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00002000:00000024:0.0:1779690740.682611:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690740.682641:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1779690740.682656:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492396416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690740.682661:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492396800:0@lo:400:kworker.0 00000100:00100000:1.0:1779690740.682662:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492397184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690740.682671:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00002000:00000024:1.0:1779690740.682685:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690740.682702:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396928 00000100:00100000:0.0:1779690740.682706:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396928 00000100:00100000:1.0:1779690740.682721:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492397184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690740.682727:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1779690740.682736:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:0.0:1779690740.682744:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492396928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.682777:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492396928:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690740.682783:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00080000:0.0:1779690740.682802:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690740.682829:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690740.682832:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690740.682843:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690740.682872:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396800 00000100:00100000:0.0:1779690740.682877:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396800 00000100:00100000:3.0:1779690740.682885:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396288 00000100:00100000:3.0:1779690740.682891:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396288 00000100:00100000:0.0:1779690740.682908:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1779690740.682917:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492396800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690740.682927:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1779690740.682937:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.682962:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492396800:12345-0@lo:400:kworker.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690740.682968:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:3.0:1779690740.682982:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492396288:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690740.682990:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1779690740.683009:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492396288:0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.683025:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492396800:0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.683061:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492396928:0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.683074:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492396416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690740.683128:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492397184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690740.683140:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492396672:0@lo:400:kworker.0 00000100:00100000:2.0:1779690740.685614:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690740.685662:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492397056:0@lo:400:kworker.0 00000100:00100000:2.0:1779690740.685693:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690740.685783:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492396544 00000100:00100000:0.0:1779690740.685787:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397056 00000100:00100000:3.0:1779690740.685790:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492396544 00000100:00100000:0.0:1779690740.685793:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397056 00000100:00080000:2.0:1779690740.685909:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690740.685946:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1779690740.685955:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492397056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690740.685992:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1779690740.686004:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492396544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690740.686009:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492397056:12345-0@lo:400:kworker.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690740.686017:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1779690740.686056:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492396544:12345-0@lo:400:kworker.0 Request processed in 55us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690740.686062:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492396544:0@lo:400:kworker.0 00000100:00100000:3.0:1779690740.686065:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1779690740.686083:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492397056:0@lo:400:kworker.0 00000040:00080000:2.0:1779690740.838360:0:78548:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690740.838367:0:78548:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690740.839083:0:78548:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690740.839093:0:78548:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690741.192977:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690741.641642:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690741.641654:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690741.642588:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690741.642603:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690742.217004:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690742.323175:0:78601:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690742.323183:0:78601:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690742.323795:0:78601:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690742.323950:0:78601:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690742.665231:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690742.665240:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690742.665872:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690742.665882:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690743.234623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690743.234662:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690743.234700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690743.234707:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878400 00000100:00100000:2.0:1779690743.234716:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878400 00000100:00100000:2.0:1779690743.234771:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:2.0:1779690743.234783:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503878400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690743.234787:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690743.234838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690743.234913:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503878400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 133us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690743.234922:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:1.0:1779690743.234932:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878656 00000100:00100000:1.0:1779690743.234945:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878656 00000100:00100000:1.0:1779690743.235026:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879168 00000100:00100000:1.0:1779690743.235030:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879168 00000100:00100000:1.0:1779690743.235071:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3132 00000100:00080000:2.0:1779690743.235082:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690743.235087:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503878656:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1779690743.235090:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690743.235140:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3133 00000100:00100000:2.0:1779690743.235151:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503879168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690743.235172:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503878656:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 90us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690743.235181:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3132 00000100:00100000:0.0:1779690743.235827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690743.235857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690743.235878:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878784 00000100:00100000:0.0:1779690743.235884:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878784 00000100:00100000:0.0:1779690743.235919:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879040 00000100:00100000:0.0:1779690743.235921:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879040 00000100:00100000:0.0:1779690743.235940:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3134 00000100:00100000:0.0:1779690743.235947:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503878784:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690743.236222:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503878784:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 274us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690743.236224:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503879168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1075us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690743.236237:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3134 00000100:00100000:2.0:1779690743.236244:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3133 00000100:00100000:0.0:1779690743.236255:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3135 00000100:00100000:0.0:1779690743.236264:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503879040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1779690743.236267:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690743.236271:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690743.236304:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503879040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690743.236310:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3135 00000100:00100000:3.0:1779690743.236583:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878912 00000100:00100000:3.0:1779690743.236589:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878912 00000100:00100000:3.0:1779690743.236641:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503878528 00000100:00100000:3.0:1779690743.236645:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503878528 00000100:00100000:3.0:1779690743.236673:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 444 00000100:00080000:0.0:1779690743.236705:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690743.236741:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503878912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690743.236744:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 445 00000100:00100000:2.0:1779690743.236757:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503878528:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690743.236789:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503878912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 110us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690743.236795:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503878528:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690743.236801:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 444 00000100:00100000:2.0:1779690743.236876:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 445 00010000:00010000:0.0:1779690743.241002:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690743.690116:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690743.690127:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690743.690801:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690743.690833:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690743.732394:0:78652:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690743.732401:0:78652:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690743.733195:0:78652:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690743.733202:0:78652:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690744.265119:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690744.713947:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690744.713957:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690744.714506:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690744.714516:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690745.186567:0:78703:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690745.186577:0:78703:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690745.187161:0:78703:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690745.187170:0:78703:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690745.289446:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690745.737307:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690745.737314:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690745.737896:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690745.737904:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690745.801002:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690745.801025:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690745.801031:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690745.801044:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492397440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690745.801096:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690745.801138:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397440 00000100:00100000:0.0:1779690745.801146:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397440 00000100:00100000:1.0:1779690745.801161:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690745.801205:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397312 00000100:00100000:2.0:1779690745.801209:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397312 00000100:00100000:0.0:1779690745.801430:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1779690745.801442:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492397440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690745.801505:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690745.801555:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492397440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690745.801562:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1779690745.801580:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1779690745.801585:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492397312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690745.801604:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690745.801653:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492397312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690745.801659:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1779690745.801734:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690745.801758:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492397696:0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.801776:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492397824:0@lo:400:kworker.0 00000100:00100000:1.0:1779690745.801796:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690745.801966:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1779690745.801973:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690745.801977:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690745.802002:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397696 00000100:00100000:1.0:1779690745.802006:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397696 00000100:00100000:3.0:1779690745.802011:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397824 00000100:00100000:3.0:1779690745.802016:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397824 00000100:00100000:1.0:1779690745.802048:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1779690745.802056:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.802065:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1779690745.802074:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690745.802285:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492397696:12345-0@lo:400:kworker.0 Request processed in 230us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690745.802302:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1779690745.802309:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492397824:12345-0@lo:400:kworker.0 Request processed in 235us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690745.802317:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00080000:1.0:1779690745.802320:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690745.802345:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492397696:0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.802350:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492397952:0@lo:400:kworker.0 00000100:00100000:1.0:1779690745.802377:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30910ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492397568:0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.802380:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690745.802411:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690745.802446:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492397440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690745.802474:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397568 00000100:00100000:1.0:1779690745.802477:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397568 00000100:00100000:3.0:1779690745.802589:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492397952 00000100:00100000:3.0:1779690745.802593:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492397952 00000100:00100000:3.0:1779690745.802682:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1779690745.802689:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492397952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.802724:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492397952:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690745.802731:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1779690745.802735:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1779690745.802745:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690745.802771:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492397824:0@lo:400:kworker.0 00000100:00100000:1.0:1779690745.802796:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492397568:12345-0@lo:400:kworker.0 Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690745.802802:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492397952:0@lo:400:kworker.0 00000100:00100000:1.0:1779690745.802823:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1779690745.802860:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30910ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492397568:0@lo:400:kworker.0 00010000:00010000:0.0:1779690746.313537:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690746.576379:0:78754:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690746.576387:0:78754:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690746.576966:0:78754:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690746.576976:0:78754:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690746.761058:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690746.761067:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690746.761621:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690746.761632:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690747.336972:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690747.786090:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690747.786096:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690747.786543:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690747.786550:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690747.983416:0:78805:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690747.983424:0:78805:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690747.984425:0:78805:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690747.984437:0:78805:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690748.352503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690748.352626:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690748.352670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690748.352693:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879552 00000100:00100000:1.0:1779690748.352702:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879552 00000100:00100000:0.0:1779690748.352704:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690748.352735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690748.352751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690748.352752:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880064 00000100:00100000:1.0:1779690748.352754:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880064 00000100:00100000:1.0:1779690748.352772:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879680 00000100:00100000:1.0:1779690748.352774:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879680 00000100:00100000:1.0:1779690748.352796:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3136 00000100:00100000:1.0:1779690748.352836:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503879552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690748.352840:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879808 00000100:00100000:3.0:1779690748.352846:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879808 00000100:00100000:0.0:1779690748.352854:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690748.352886:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879424 00000100:00100000:3.0:1779690748.352890:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879424 00000100:00100000:0.0:1779690748.352901:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879936 00000100:00100000:1.0:1779690748.352906:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503879552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690748.352915:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3136 00000100:00100000:0.0:1779690748.352916:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879936 00000100:00100000:3.0:1779690748.352921:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 449 00000100:00100000:3.0:1779690748.352934:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503879808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690748.352952:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3137 00000100:00100000:2.0:1779690748.352954:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503879296 00000100:00100000:2.0:1779690748.352961:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503879296 00000100:00100000:1.0:1779690748.352962:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503880064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690748.352962:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3138 00000100:00100000:3.0:1779690748.352974:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503879808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690748.352975:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503879680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690748.352988:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 449 00000100:00100000:1.0:1779690748.352998:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503880064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690748.353004:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503879680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690748.353007:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3137 00000100:00100000:2.0:1779690748.353011:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 269 00000100:00100000:3.0:1779690748.353012:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 450 00000100:00100000:0.0:1779690748.353017:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3138 00000100:00100000:3.0:1779690748.353030:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503879424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690748.353030:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3139 00000100:00100000:2.0:1779690748.353040:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503879296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690748.353041:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503879936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1779690748.353058:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1779690748.353063:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690748.353068:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503879424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00080000:0.0:1779690748.353068:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690748.353080:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 450 00000100:00100000:1.0:1779690748.353081:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503879936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690748.353087:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3139 00000100:00100000:2.0:1779690748.353225:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503879296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 202us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690748.353290:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 269 00010000:00010000:0.0:1779690748.362212:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690748.809059:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690748.809067:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690748.809632:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690748.809643:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690749.388065:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690749.416242:0:78857:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690749.416252:0:78857:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690749.416801:0:78857:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690749.416836:0:78857:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690749.833046:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690749.833055:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690749.833898:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690749.833909:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690750.408960:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690750.829282:0:78908:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690750.829290:0:78908:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690750.829936:0:78908:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690750.829946:0:78908:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690750.857238:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690750.857244:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690750.857794:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690750.857819:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690750.921123:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492398208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690750.921160:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690750.921176:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492398080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690750.921192:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690750.921256:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398208 00000100:00100000:2.0:1779690750.921257:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690750.921265:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398208 00000100:00080000:3.0:1779690750.921305:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690750.921323:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398080 00000100:00100000:0.0:1779690750.921327:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398080 00000100:00100000:2.0:1779690750.921343:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00080000:3.0:1779690750.921350:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690750.921357:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492398208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690750.921391:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:0.0:1779690750.921398:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1779690750.921406:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492398080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690750.921425:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690750.921458:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492398208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690750.921466:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1779690750.921496:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492398080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690750.921503:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1779690750.921553:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492398080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690750.921557:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492398208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690750.922586:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492398336:0@lo:400:kworker.0 00000100:00100000:3.0:1779690750.922617:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f82995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492398720:0@lo:400:kworker.0 00000100:00100000:2.0:1779690750.922627:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690750.922653:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690750.922701:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492398464:0@lo:400:kworker.0 00000100:00100000:3.0:1779690750.922726:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690750.922757:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690750.922765:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492398592:0@lo:400:kworker.0 00000100:00100000:2.0:1779690750.922769:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398720 00000100:00100000:2.0:1779690750.922774:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398720 00000100:00100000:3.0:1779690750.922792:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690750.922840:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398464 00000100:00100000:2.0:1779690750.922845:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398592 00000100:00100000:1.0:1779690750.922845:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398464 00000100:00100000:0.0:1779690750.922848:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398336 00000100:00100000:2.0:1779690750.922851:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398592 00000100:00100000:0.0:1779690750.922853:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398336 00000100:00100000:1.0:1779690750.922880:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1779690750.922885:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1779690750.922887:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1779690750.922889:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492398720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690750.922899:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492398464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690750.922901:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690750.923398:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1779690750.923400:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492398720:12345-0@lo:400:kworker.0 Request processed in 512us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690750.923411:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1779690750.923412:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690750.923424:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492398464:12345-0@lo:400:kworker.0 Request processed in 526us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690750.923431:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00080000:1.0:1779690750.923444:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690750.923466:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492398592:12345-0@lo:400:kworker.0 Request processed in 57us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690750.923474:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1779690750.923482:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f82995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492398720:0@lo:400:kworker.0 00000100:00100000:3.0:1779690750.923513:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492398592:0@lo:400:kworker.0 00000100:00100000:3.0:1779690750.923521:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492398464:0@lo:400:kworker.0 00000100:00100000:0.0:1779690750.923761:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492398336:12345-0@lo:400:kworker.0 Request processed in 862us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690750.923769:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1779690750.923948:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492398336:0@lo:400:kworker.0 00010000:00010000:0.0:1779690751.433575:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690751.881056:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690751.881064:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690751.881631:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690751.881641:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690752.274280:0:78959:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690752.274286:0:78959:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690752.276603:0:78959:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690752.276622:0:78959:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690752.457043:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690752.905104:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690752.905115:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690752.905669:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690752.905679:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690753.478738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690753.478857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690753.478894:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690753.479041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690753.479043:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880320 00000100:00100000:1.0:1779690753.479053:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880320 00000100:00100000:0.0:1779690753.479064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690753.479113:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 454 00000100:00100000:1.0:1779690753.479124:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503880320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690753.479188:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503880320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690753.479195:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 454 00000100:00080000:1.0:1779690753.479217:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690753.481966:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880576 00000100:00100000:2.0:1779690753.481977:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880576 00000100:00100000:2.0:1779690753.482039:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880832 00000100:00100000:2.0:1779690753.482042:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880832 00000100:00100000:2.0:1779690753.482068:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3140 00000100:00100000:2.0:1779690753.482078:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503880576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690753.482152:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503880576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690753.482161:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3140 00000100:00100000:2.0:1779690753.482177:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3141 00000100:00100000:2.0:1779690753.482185:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503880832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690753.482389:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503880832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 105us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690753.482397:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3141 00010000:00010000:2.0:1779690753.482555:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1779690753.482563:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690753.482567:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690753.482837:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880192 00000100:00100000:2.0:1779690753.482842:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880192 00000100:00100000:2.0:1779690753.482870:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:2.0:1779690753.482877:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503880192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690753.482915:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503880192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (3876us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690753.482921:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:0.0:1779690753.484681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690753.484708:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880448 00000100:00100000:0.0:1779690753.484709:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880704 00000100:00100000:2.0:1779690753.484715:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880448 00000100:00100000:0.0:1779690753.484715:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880704 00000100:00100000:2.0:1779690753.485782:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3142 00000100:00100000:2.0:1779690753.485794:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503880448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690753.485869:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503880448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 78us (6803us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690753.485876:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3142 00000100:00100000:2.0:1779690753.485931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690753.487657:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503880960 00000100:00100000:1.0:1779690753.487668:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503880960 00000100:00100000:1.0:1779690753.487723:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3143 00000100:00100000:1.0:1779690753.487734:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503880960:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690753.487789:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503880960:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 59us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690753.487796:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3143 00000100:00100000:0.0:1779690753.488865:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 455 00000100:00100000:0.0:1779690753.488879:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503880704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690753.489674:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503880704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 800us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690753.489683:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 455 00000100:00080000:2.0:1779690753.489843:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690753.489848:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690753.489851:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1779690753.811397:0:79010:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690753.811405:0:79010:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690753.814357:0:79010:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690753.814375:0:79010:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690753.929043:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690753.929051:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690753.929661:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690753.929670:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690754.505040:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690754.953290:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690754.953298:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690754.953914:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690754.953921:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690755.276377:0:79061:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690755.276385:0:79061:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690755.277069:0:79061:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690755.277085:0:79061:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690755.529048:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690755.977226:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690755.977234:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690755.977777:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690755.977787:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690756.041304:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8ca35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492398848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690756.041359:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492399232:0@lo:400:kworker.0 00000100:00100000:0.0:1779690756.041376:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690756.041389:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690756.041466:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1779690756.041529:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492399360:0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.041557:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690756.041596:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398848 00000100:00100000:2.0:1779690756.041602:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398848 00000100:00100000:1.0:1779690756.041661:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399360 00000100:00100000:1.0:1779690756.041666:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399360 00000100:00100000:1.0:1779690756.041700:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:1.0:1779690756.041708:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492399360:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1779690756.041765:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690756.041769:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690756.041798:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1779690756.041826:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492398848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690756.041856:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690756.041900:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492398848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690756.041907:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1779690756.041948:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8ca35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492398848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690756.042030:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492398976:0@lo:400:kworker.0 00000100:00100000:3.0:1779690756.042093:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690756.042166:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492399360:12345-0@lo:400:kworker.0 Request processed in 458us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690756.042168:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492399360:0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042315:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399232 00000100:00100000:2.0:1779690756.042320:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399232 00000100:00100000:2.0:1779690756.042355:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1779690756.042362:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492399232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042398:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492399232:12345-0@lo:400:kworker.0 Request processed in 36us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690756.042404:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1779690756.042430:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492399104:0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042455:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690756.042558:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399104 00000100:00100000:2.0:1779690756.042562:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399104 00000100:00100000:2.0:1779690756.042587:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1779690756.042593:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492399104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042628:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492399104:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690756.042634:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:2.0:1779690756.042654:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690756.042658:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:2.0:1779690756.042676:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8a343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492399104:0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042706:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492399232:0@lo:400:kworker.0 00000100:00100000:2.0:1779690756.042729:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492398976 00000100:00100000:2.0:1779690756.043102:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492398976 00000100:00100000:2.0:1779690756.043131:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1779690756.043138:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492398976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690756.043149:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690756.043190:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492398976:12345-0@lo:400:kworker.0 Request processed in 52us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690756.043202:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690756.043242:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399616 00000100:00100000:1.0:1779690756.043246:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399616 00000100:00100000:1.0:1779690756.043267:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1779690756.043312:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1779690756.043336:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492399616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690756.043360:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690756.043407:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492399616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690756.043422:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1779690756.043567:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690756.043983:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492398976:0@lo:400:kworker.0 00000100:00100000:3.0:1779690756.043991:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30888f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492399488:0@lo:400:kworker.0 00000100:00100000:3.0:1779690756.044020:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690756.044067:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399488 00000100:00100000:0.0:1779690756.044072:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399488 00000100:00100000:0.0:1779690756.044106:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1779690756.044113:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492399488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690756.044148:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492399488:12345-0@lo:400:kworker.0 Request processed in 35us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690756.044155:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1779690756.045457:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30888f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492399488:0@lo:400:kworker.0 00010000:00010000:2.0:1779690756.556738:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690756.848254:0:79113:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690756.848263:0:79113:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690756.850222:0:79113:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690756.850237:0:79113:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690757.002116:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690757.002125:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690757.003081:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690757.003093:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690757.577306:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690758.025028:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690758.025036:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690758.025706:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690758.025717:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690758.379906:0:79164:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690758.379915:0:79164:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690758.380437:0:79164:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690758.380446:0:79164:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690758.592331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690758.592377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690758.592474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690758.592511:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690758.592529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690758.592564:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690758.592642:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881472 00000100:00100000:2.0:1779690758.592645:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881088 00000100:00100000:2.0:1779690758.592652:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881088 00000100:00100000:0.0:1779690758.592652:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881472 00000100:00100000:0.0:1779690758.592708:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881728 00000100:00100000:2.0:1779690758.592710:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:0.0:1779690758.592712:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881728 00000100:00100000:2.0:1779690758.592726:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503881088:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690758.592736:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881344 00000100:00100000:0.0:1779690758.592740:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881344 00000100:00100000:0.0:1779690758.592764:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3145 00000100:00100000:0.0:1779690758.592772:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503881472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690758.592796:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bccfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503881088:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690758.592841:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:0.0:1779690758.592848:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503881472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690758.592855:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3145 00000100:00100000:2.0:1779690758.592880:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3146 00000100:00100000:2.0:1779690758.592889:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503881728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690758.592895:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3147 00000100:00100000:0.0:1779690758.592905:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503881344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690758.592922:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+19:2391:x1866137503881728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690758.592928:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3146 00000100:00100000:0.0:1779690758.592940:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503881344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690758.592948:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3147 00000100:00080000:0.0:1779690758.592971:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690758.592975:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690758.593595:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690758.595044:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881856 00000100:00100000:0.0:1779690758.595053:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881856 00000100:00100000:0.0:1779690758.595126:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3148 00000100:00100000:0.0:1779690758.595135:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503881856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690758.595193:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503881856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 59us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690758.595212:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3148 00000100:00080000:1.0:1779690758.595619:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690758.596105:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881216 00000100:00100000:3.0:1779690758.596111:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881216 00000100:00100000:3.0:1779690758.596250:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881600 00000100:00100000:3.0:1779690758.596254:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881600 00000100:00100000:0.0:1779690758.596305:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 459 00000100:00100000:0.0:1779690758.596314:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503881216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690758.596361:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30888f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503881216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 48us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690758.596368:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 459 00000100:00080000:1.0:1779690758.596529:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690758.596926:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 460 00000100:00100000:3.0:1779690758.596933:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503881600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690758.596971:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503881600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690758.596983:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 460 00010000:00010000:2.0:1779690758.601137:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690759.049046:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690759.049054:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690759.049657:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690759.049667:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690759.633235:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690759.929420:0:79215:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690759.929430:0:79215:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690759.930063:0:79215:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690759.930074:0:79215:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690760.073039:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690760.073047:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690760.075310:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690760.075328:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690760.649128:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690761.100019:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690761.100026:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690761.100534:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690761.100543:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690761.161009:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f89d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492399872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690761.161009:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492399744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690761.161082:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690761.161129:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399744 00000100:00100000:2.0:1779690761.161137:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399744 00000100:00080000:1.0:1779690761.161169:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690761.161197:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1779690761.161209:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492399744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690761.161255:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690761.161296:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492399744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690761.161303:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1779690761.161337:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690761.161359:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492399744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690761.161364:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492399872 00000100:00100000:1.0:1779690761.161381:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492399872 00000100:00100000:1.0:1779690761.161424:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1779690761.161431:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492399872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690761.161448:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690761.161492:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492399872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690761.161500:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:0.0:1779690761.161516:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690761.161947:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f89d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492399872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690761.161958:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492400000:0@lo:400:kworker.0 00000100:00100000:2.0:1779690761.161965:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492400256:0@lo:400:kworker.0 00000100:00100000:3.0:1779690761.162000:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690761.162005:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690761.162038:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690761.162045:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492400128:0@lo:400:kworker.0 00000100:00100000:1.0:1779690761.162135:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492400384:0@lo:400:kworker.0 00000100:00100000:2.0:1779690761.162309:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400256 00000100:00100000:1.0:1779690761.162312:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690761.162315:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400256 00000100:00080000:0.0:1779690761.162344:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690761.162352:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400384 00000100:00100000:1.0:1779690761.162357:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400384 00000100:00100000:2.0:1779690761.162364:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1779690761.162384:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492400256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690761.162399:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1779690761.162408:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492400384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690761.162430:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492400256:12345-0@lo:400:kworker.0 Request processed in 59us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690761.162438:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1779690761.162454:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492400384:12345-0@lo:400:kworker.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690761.162461:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1779690761.162473:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492400256:0@lo:400:kworker.0 00000100:00100000:1.0:1779690761.162498:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f83691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492400384:0@lo:400:kworker.0 00000100:00100000:2.0:1779690761.162505:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400000 00000100:00100000:2.0:1779690761.162510:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400000 00000100:00100000:2.0:1779690761.162536:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1779690761.162543:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690761.162586:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492400000:12345-0@lo:400:kworker.0 Request processed in 43us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690761.162590:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690761.162595:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1779690761.162676:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492400000:0@lo:400:kworker.0 00000100:00100000:1.0:1779690761.162721:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400128 00000100:00100000:1.0:1779690761.162725:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400128 00000100:00080000:2.0:1779690761.162753:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690761.162799:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1779690761.162890:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690761.162933:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492400128:12345-0@lo:400:kworker.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690761.162946:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1779690761.162974:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3083977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492400128:0@lo:400:kworker.0 00000040:00080000:0.0:1779690761.420749:0:79266:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690761.420756:0:79266:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690761.421621:0:79266:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690761.421639:0:79266:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690761.673008:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690762.049893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690762.049998:0:5780:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503881984 00000100:00100000:3.0:1779690762.050007:0:5780:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503881984 00000100:00100000:3.0:1779690762.050120:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18697 00000100:00100000:3.0:1779690762.050130:0:5780:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+19:2392:x1866137503881984:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1779690762.050144:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:3.0:1779690762.050184:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084c1ebfd/0xb4bb873a1914090c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee5b5 expref: 19 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690762.050214:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b4fa77/0xb4bb873a191409de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bee602 expref: 18 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690762.050233:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f36fa89/0xb4bb873a1913e755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bedb6d expref: 17 pid: 22747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690762.050272:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f385b9/0xb4bb873a1913ddc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed880 expref: 16 pid: 40949 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690762.050289:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1e6:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1779690762.050296:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433821dd/0xb4bb873a1913dbf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed7f4 expref: 15 pid: 10273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690762.050313:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1c4:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690762.050316:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1c4:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050318:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1c4:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050332:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1c4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690762.050341:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a87de250/0xb4bb873a1913c582 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed18e expref: 14 pid: 15940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690762.050358:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1c3:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690762.050360:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1c3:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050373:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1c3:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050374:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1c3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690762.050381:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c740afd/0xb4bb873a1913c4b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed109 expref: 13 pid: 40949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690762.050396:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1c2:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690762.050398:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1c2:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050400:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1c2:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050402:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1c2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690762.050408:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff63528/0xb4bb873a1913c408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed0c3 expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1779690762.050422:0:5780:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x1c1:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:3.0:1779690762.050425:0:5780:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x1c1:0x0] updating lvb mtime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050427:0:5780:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x1c1:0x0] updating lvb ctime from disk: 0 -> 1779690159 00002000:00010000:3.0:1779690762.050429:0:5780:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x1c1:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1779690762.050436:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9e6fba/0xb4bb873a1913c34b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.5@tcp remote: 0xa5ac8fd750bed076 expref: 11 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1779690762.050447:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1779690762.050504:0:5780:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503881984:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 376us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690762.050518:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18697 00000100:00080000:2.0:1779690762.050638:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1779690762.122121:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690762.122129:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690762.122791:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690762.122802:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690762.697994:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690762.960416:0:79317:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690762.960425:0:79317:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690762.960976:0:79317:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690762.960985:0:79317:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690763.145039:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690763.145048:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690763.145599:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690763.145609:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690763.714535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690763.714687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690763.714729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690763.714767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690763.714795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690763.714851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690763.714863:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882368 00000100:00100000:1.0:1779690763.714874:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882368 00000100:00100000:0.0:1779690763.714938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690763.714939:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882880 00000100:00100000:1.0:1779690763.714943:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882880 00000100:00100000:1.0:1779690763.714970:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882496 00000100:00100000:1.0:1779690763.714974:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882496 00000100:00100000:2.0:1779690763.715026:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882112 00000100:00100000:2.0:1779690763.715032:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882112 00000100:00100000:2.0:1779690763.715062:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:3.0:1779690763.715100:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882624 00000100:00100000:3.0:1779690763.715104:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882624 00000100:00100000:3.0:1779690763.715133:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882240 00000100:00100000:3.0:1779690763.715136:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882240 00000100:00100000:2.0:1779690763.715171:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503882112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690763.715214:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 464 00000100:00100000:3.0:1779690763.715222:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503882624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690763.715278:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503882112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 207us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690763.715304:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:3.0:1779690763.715365:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503882624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 143us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690763.715372:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 464 00000100:00100000:3.0:1779690763.715387:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 465 00000100:00100000:3.0:1779690763.715394:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503882240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690763.715416:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f93570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503882240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690763.715433:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 465 00000100:00100000:0.0:1779690763.715539:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503882752 00000100:00100000:0.0:1779690763.715544:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503882752 00000100:00100000:0.0:1779690763.715577:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3149 00000100:00100000:0.0:1779690763.715586:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503882368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690763.715612:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3150 00000100:00100000:0.0:1779690763.715619:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ca35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503882368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690763.715627:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503882880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690763.715632:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3149 00000100:00100000:3.0:1779690763.715653:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3151 00000100:00100000:0.0:1779690763.715663:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3152 00000100:00100000:3.0:1779690763.715672:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503882496:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690763.715672:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503882880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 48us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690763.715676:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503882752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690763.715690:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3150 00000100:00100000:3.0:1779690763.715709:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503882496:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690763.715718:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3151 00000100:00100000:0.0:1779690763.715721:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503882752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690763.715730:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3152 00000100:00080000:3.0:1779690763.715745:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690763.715750:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690763.715753:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1779690763.721535:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690764.173014:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690764.173027:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690764.174891:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690764.174905:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690764.396306:0:79369:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690764.396313:0:79369:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690764.396965:0:79369:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690764.396974:0:79369:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690764.744957:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690765.193126:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690765.193136:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690765.193731:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690765.193739:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690765.769509:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690765.955379:0:79420:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690765.955387:0:79420:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690765.956153:0:79420:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690765.956164:0:79420:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690766.217264:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690766.217272:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690766.217768:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690766.217776:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690766.280983:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492400512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690766.281046:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492400640:0@lo:400:kworker.0 00000100:00100000:2.0:1779690766.281057:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690766.281061:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492400896:0@lo:400:kworker.0 00000100:00100000:0.0:1779690766.281151:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492400768:0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.281486:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690766.281606:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690766.281696:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690766.281722:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1779690766.281729:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.281881:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690766.281912:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400640 00000100:00100000:1.0:1779690766.281918:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400640 00000100:00100000:1.0:1779690766.281953:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1779690766.281960:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.282002:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492400640:12345-0@lo:400:kworker.0 Request processed in 43us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690766.282008:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1779690766.282035:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400512 00000100:00100000:1.0:1779690766.282038:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400512 00000100:00100000:1.0:1779690766.282064:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401152 00000100:00100000:1.0:1779690766.282066:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401152 00000100:00100000:1.0:1779690766.282078:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1779690766.282084:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492400512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690766.282109:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690766.282139:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492400512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690766.282144:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1779690766.282157:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1779690766.282162:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690766.282178:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690766.282206:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f94fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690766.282212:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1779690766.282228:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30a8e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492400512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690766.282243:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401024 00000100:00100000:1.0:1779690766.282247:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401024 00000100:00100000:0.0:1779690766.282252:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1779690766.282275:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690766.282280:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690766.282287:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1779690766.282295:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690766.282302:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690766.282347:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492401408:0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.282353:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401024:12345-0@lo:400:kworker.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690766.282359:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:3.0:1779690766.282380:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690766.282389:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401024:0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.282400:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8d2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492400640:0@lo:400:kworker.0 00000100:00100000:0.0:1779690766.282407:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492401280:0@lo:400:kworker.0 00000100:00100000:1.0:1779690766.282415:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f8f40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690766.282516:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690766.282552:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401280 00000100:00100000:0.0:1779690766.282556:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401280 00000100:00100000:2.0:1779690766.282638:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400768 00000100:00100000:2.0:1779690766.282650:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400768 00000100:00100000:0.0:1779690766.282655:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1779690766.282664:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492401280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690766.282693:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492400896 00000100:00100000:2.0:1779690766.282697:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492400896 00000100:00100000:0.0:1779690766.282705:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492401280:12345-0@lo:400:kworker.0 Request processed in 43us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690766.282713:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:2.0:1779690766.282727:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1779690766.282737:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492400768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690766.282749:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492401280:0@lo:400:kworker.0 00000100:00100000:0.0:1779690766.282787:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1779690766.282794:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492400896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690766.282839:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492400768:12345-0@lo:400:kworker.0 Request processed in 104us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690766.282846:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1779690766.282868:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492400896:12345-0@lo:400:kworker.0 Request processed in 73us (568us total) trans 0 rc 0/0 00000100:00080000:2.0:1779690766.282869:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690766.282881:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1779690766.282917:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492400768:0@lo:400:kworker.0 00000100:00100000:3.0:1779690766.283086:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492400896:0@lo:400:kworker.0 00000100:00100000:2.0:1779690766.283093:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401408 00000100:00100000:2.0:1779690766.283097:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401408 00000100:00100000:2.0:1779690766.283194:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1779690766.283200:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492401408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690766.283241:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f963e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492401408:12345-0@lo:400:kworker.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690766.283248:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1779690766.283267:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492401408:0@lo:400:kworker.0 00010000:00010000:2.0:1779690766.793065:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690767.241112:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690767.241120:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690767.241663:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690767.241672:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690767.546417:0:79471:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690767.546425:0:79471:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690767.549032:0:79471:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690767.549045:0:79471:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690767.817173:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690768.265555:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690768.265562:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690768.266159:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690768.266169:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690768.835185:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835223:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690768.835765:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883392 00000100:00100000:1.0:1779690768.835773:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883392 00000100:00100000:0.0:1779690768.835828:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883648 00000100:00100000:0.0:1779690768.835833:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883648 00000100:00100000:1.0:1779690768.835846:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883776 00000100:00100000:1.0:1779690768.835850:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883776 00000100:00100000:0.0:1779690768.835872:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883264 00000100:00100000:0.0:1779690768.835876:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883264 00000100:00100000:1.0:1779690768.836020:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3155 00000100:00100000:1.0:1779690768.836033:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503883392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690768.836078:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883136 00000100:00100000:2.0:1779690768.836082:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883136 00000100:00100000:2.0:1779690768.836113:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883520 00000100:00100000:2.0:1779690768.836116:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883520 00000100:00100000:2.0:1779690768.836139:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 469 00000100:00100000:2.0:1779690768.836147:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503883136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690768.836226:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503883136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690768.836233:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 469 00000100:00100000:2.0:1779690768.836251:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 470 00000100:00100000:2.0:1779690768.836265:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503883520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690768.836291:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8d2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503883520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690768.836297:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 470 00000100:00080000:2.0:1779690768.836325:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690768.836330:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690768.836332:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690768.836516:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3156 00000100:00100000:0.0:1779690768.836525:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503883648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690768.836554:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503883648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690768.836560:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3156 00000100:00100000:0.0:1779690768.836576:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3157 00000100:00100000:0.0:1779690768.836582:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503883776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690768.836604:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503883776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690768.836610:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3157 00000100:00100000:0.0:1779690768.836622:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3158 00000100:00100000:0.0:1779690768.836635:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503883264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690768.836659:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503883264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690768.836664:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3158 00000100:00100000:2.0:1779690768.836896:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883008 00000100:00100000:2.0:1779690768.836901:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883008 00000100:00100000:2.0:1779690768.836936:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:2.0:1779690768.836942:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503883008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690768.836967:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503883008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690768.836973:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:1.0:1779690768.838430:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30a8e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503883392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2389us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690768.838440:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3155 00010000:00010000:3.0:1779690768.840941:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690769.047445:0:79522:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690769.047452:0:79522:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690769.047902:0:79522:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690769.047912:0:79522:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690769.289062:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690769.289070:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690769.289684:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690769.289693:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690769.865035:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690770.317018:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690770.317026:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690770.318052:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690770.318221:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690770.536673:0:79573:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690770.536679:0:79573:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690770.537169:0:79573:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690770.537176:0:79573:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690770.891461:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690771.337063:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690771.337072:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690771.337643:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690771.337652:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690771.400982:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690771.401003:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492401792:0@lo:400:kworker.0 00000100:00100000:3.0:1779690771.401029:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492401664:0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.401122:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492401920:0@lo:400:kworker.0 00000100:00100000:1.0:1779690771.401729:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690771.401777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690771.401799:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492402176:0@lo:400:kworker.0 00000100:00100000:1.0:1779690771.402035:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690771.402067:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401536 00000100:00100000:1.0:1779690771.402074:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401536 00000100:00100000:1.0:1779690771.402117:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1779690771.402124:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690771.402154:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690771.402202:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492401536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690771.402209:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1779690771.402230:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401792 00000100:00100000:1.0:1779690771.402233:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401792 00000100:00100000:1.0:1779690771.402257:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1779690771.402262:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492401792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690771.402288:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492401792:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690771.402322:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1779690771.402358:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f96d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492401536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1779690771.402388:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690771.402392:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690771.402402:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402176 00000100:00100000:1.0:1779690771.402405:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402176 00000100:00100000:1.0:1779690771.402429:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:1.0:1779690771.402435:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492402176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690771.402467:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492402176:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690771.402473:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1779690771.402494:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492402304:0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.403649:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690771.403690:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492402432:0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.403719:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690771.403757:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401920 00000100:00100000:2.0:1779690771.403762:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401920 00000100:00100000:2.0:1779690771.403795:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402432 00000100:00100000:2.0:1779690771.403798:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402432 00000100:00100000:2.0:1779690771.404036:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1779690771.404044:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.404085:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492401920:12345-0@lo:400:kworker.0 Request processed in 42us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690771.404101:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1779690771.404116:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1779690771.404122:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492402432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.404149:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3083976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492402432:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690771.404154:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:2.0:1779690771.404173:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690771.404197:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492401920:0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.404209:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492402432:0@lo:400:kworker.0 00000100:00100000:0.0:1779690771.406621:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690771.406663:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690771.406711:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492401792:0@lo:400:kworker.0 00000100:00100000:3.0:1779690771.406776:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492402048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690771.406865:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402304 00000100:00100000:2.0:1779690771.406872:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402304 00000100:00100000:3.0:1779690771.406894:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690771.406932:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1779690771.406937:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492401664 00000100:00100000:3.0:1779690771.406941:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492401664 00000100:00100000:2.0:1779690771.406943:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492402304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690771.406975:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1779690771.406984:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492401664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.406997:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492402304:12345-0@lo:400:kworker.0 Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690771.407004:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:2.0:1779690771.407044:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402048 00000100:00100000:2.0:1779690771.407047:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402048 00000100:00100000:3.0:1779690771.407076:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492401664:12345-0@lo:400:kworker.0 Request processed in 93us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690771.407077:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1779690771.407088:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492402048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690771.407089:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00002000:00000024:2.0:1779690771.407118:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690771.407149:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492401664:0@lo:400:kworker.0 00000100:00100000:2.0:1779690771.407157:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492402048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690771.407164:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1779690771.407170:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492402048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1779690771.407264:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690771.407285:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492402304:0@lo:400:kworker.0 00000100:00100000:1.0:1779690771.408240:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492402176:0@lo:400:kworker.0 00010000:00010000:1.0:1779690771.913179:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690772.013195:0:79625:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690772.013203:0:79625:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690772.013655:0:79625:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690772.013662:0:79625:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690772.361130:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690772.361141:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690772.362512:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690772.362534:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690772.937003:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690773.385019:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690773.385027:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690773.385561:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690773.385570:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690773.512635:0:79676:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690773.512642:0:79676:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690773.513160:0:79676:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690773.513169:0:79676:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690773.953076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690773.953186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690773.953240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690773.953324:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884288 00000100:00100000:0.0:1779690773.953338:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884288 00000100:00100000:3.0:1779690773.953477:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884544 00000100:00100000:3.0:1779690773.953585:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884544 00000100:00100000:0.0:1779690773.953655:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3161 00000100:00100000:2.0:1779690773.953682:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884032 00000100:00100000:2.0:1779690773.953686:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884032 00000100:00100000:2.0:1779690773.953734:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 474 00000100:00080000:1.0:1779690773.953845:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690773.953851:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690773.953854:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690773.953930:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503884032:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690773.953933:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503884288:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690773.954022:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f96d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503884032:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 281us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690773.954037:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 474 00000100:00100000:0.0:1779690773.954039:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503884288:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 353us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690773.954052:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3161 00000100:00100000:0.0:1779690773.954079:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3162 00000100:00100000:0.0:1779690773.954087:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503884544:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690773.954119:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503884544:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690773.954127:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3162 00000100:00100000:0.0:1779690773.956260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690773.956314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690773.956347:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690773.956398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690773.956433:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884160 00000100:00100000:0.0:1779690773.956443:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884160 00000100:00100000:0.0:1779690773.956502:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884672 00000100:00100000:0.0:1779690773.956505:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884672 00000100:00100000:0.0:1779690773.956530:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3163 00000100:00100000:0.0:1779690773.956540:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503884160:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690773.956609:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30910c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503884160:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690773.956616:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3163 00000100:00100000:0.0:1779690773.956632:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3164 00000100:00100000:0.0:1779690773.956639:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503884672:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690773.956668:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503884672:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690773.956691:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3164 00000100:00080000:1.0:1779690773.956718:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690773.956730:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690773.956888:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503883904 00000100:00100000:2.0:1779690773.956899:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503883904 00000100:00100000:3.0:1779690773.956939:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884416 00000100:00100000:3.0:1779690773.956946:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884416 00000100:00100000:2.0:1779690773.956980:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 279 00000100:00100000:2.0:1779690773.956995:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503883904:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690773.957008:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 475 00000100:00100000:3.0:1779690773.957019:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503884416:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690773.957077:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503883904:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690773.957084:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 279 00000100:00080000:1.0:1779690773.957192:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690773.959024:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f83089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503884416:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1994us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690773.959041:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 475 00010000:00010000:1.0:1779690773.962040:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690774.409118:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690774.409127:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690774.409673:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690774.409683:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690774.925661:0:79727:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690774.925667:0:79727:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690774.926208:0:79727:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690774.926217:0:79727:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690774.986143:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690775.433031:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690775.433039:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690775.433677:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690775.433686:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690776.008939:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690776.376856:0:79778:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690776.376868:0:79778:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690776.377433:0:79778:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690776.377443:0:79778:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690776.458175:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690776.458186:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690776.458928:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690776.458943:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690776.521088:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690776.521118:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492402560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690776.521382:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690776.521510:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492402688:0@lo:400:kworker.0 00000100:00100000:2.0:1779690776.521522:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492403072:0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.521551:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690776.521584:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492402816:0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.521595:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492403200:0@lo:400:kworker.0 00000100:00100000:2.0:1779690776.521596:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690776.521655:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690776.521668:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492402944:0@lo:400:kworker.0 00000100:00100000:0.0:1779690776.521684:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690776.521709:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402688 00000100:00100000:2.0:1779690776.521723:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403072 00000100:00100000:2.0:1779690776.521729:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403072 00000100:00100000:1.0:1779690776.521730:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402688 00000100:00100000:0.0:1779690776.521751:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30847d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690776.521794:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1779690776.521835:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492402688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690776.521860:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1779690776.521870:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492403072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690776.521913:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690776.521915:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492402688:12345-0@lo:400:kworker.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690776.521930:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492403072:12345-0@lo:400:kworker.0 Request processed in 61us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690776.521934:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1779690776.521943:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:1.0:1779690776.521986:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403200 00000100:00100000:1.0:1779690776.521991:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403200 00000100:00100000:2.0:1779690776.521998:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492403072:0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.522023:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402816 00000100:00100000:1.0:1779690776.522035:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402816 00000100:00100000:2.0:1779690776.522051:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1779690776.522061:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492403200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.522071:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1779690776.522080:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690776.522099:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492403200:12345-0@lo:400:kworker.0 Request processed in 40us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690776.522106:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1779690776.522123:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492402816:12345-0@lo:400:kworker.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690776.522131:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00080000:2.0:1779690776.522132:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690776.522139:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690776.522162:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492402688:0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.522174:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492403200:0@lo:400:kworker.0 00000100:00100000:2.0:1779690776.522181:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690776.522213:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402944 00000100:00100000:1.0:1779690776.522216:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402944 00000100:00100000:1.0:1779690776.522247:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1779690776.522268:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492402944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1779690776.522279:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690776.522323:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492402944:12345-0@lo:400:kworker.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690776.522330:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1779690776.522479:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492402560 00000100:00100000:1.0:1779690776.522485:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492402560 00000100:00100000:0.0:1779690776.522493:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492402816:0@lo:400:kworker.0 00000100:00100000:1.0:1779690776.522531:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403328 00000100:00100000:1.0:1779690776.522536:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403328 00000100:00100000:1.0:1779690776.522557:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00080000:0.0:1779690776.522558:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690776.522567:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492402560:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690776.522601:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00002000:00000024:1.0:1779690776.522609:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690776.522618:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492403328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1779690776.522655:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690776.522665:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492402560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690776.522673:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1779690776.522721:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492403328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690776.522728:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1779690776.522732:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30865e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492402560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690776.522789:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30847d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690776.523024:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492402944:0@lo:400:kworker.0 00010000:00010000:1.0:1779690777.033376:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690777.481660:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690777.481670:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690777.484197:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690777.484214:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690777.870855:0:79830:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690777.870863:0:79830:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690777.871522:0:79830:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690777.871531:0:79830:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690778.057220:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690778.505795:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690778.505823:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690778.506402:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690778.506412:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690779.074352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690779.074388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690779.074409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690779.074443:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690779.074517:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885056 00000100:00100000:1.0:1779690779.074526:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885056 00000100:00100000:1.0:1779690779.074579:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885568 00000100:00100000:1.0:1779690779.074582:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885568 00000100:00100000:1.0:1779690779.074604:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3166 00000100:00100000:1.0:1779690779.074614:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503885056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690779.074680:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503885056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690779.074688:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3166 00000100:00100000:1.0:1779690779.074701:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3167 00000100:00100000:1.0:1779690779.074707:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503885568:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690779.074728:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503885568:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690779.074734:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3167 00000100:00080000:0.0:1779690779.074917:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690779.074928:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1779690779.074981:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885312 00000100:00100000:3.0:1779690779.074985:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885312 00000100:00100000:3.0:1779690779.075035:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 479 00000100:00100000:3.0:1779690779.075043:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503885312:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1779690779.075050:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690779.075083:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503885312:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690779.075089:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 479 00000100:00100000:2.0:1779690779.075248:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884800 00000100:00100000:2.0:1779690779.075252:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884800 00000100:00100000:1.0:1779690779.075463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690779.075524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690779.075557:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:1.0:1779690779.075607:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690779.075634:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885184 00000100:00100000:1.0:1779690779.075638:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885184 00000100:00100000:0.0:1779690779.075658:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885440 00000100:00100000:0.0:1779690779.075664:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885440 00000100:00100000:1.0:1779690779.075674:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3168 00000100:00100000:1.0:1779690779.075683:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503885184:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690779.075704:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3169 00000100:00100000:0.0:1779690779.075713:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503885440:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690779.075720:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503885184:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690779.075726:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3168 00000100:00080000:1.0:1779690779.075745:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690779.075748:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1779690779.075753:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503885440:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690779.075760:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3169 00000100:00100000:2.0:1779690779.075952:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503884800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690779.075990:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503884800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690779.075996:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:3.0:1779690779.076169:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503884928 00000100:00100000:3.0:1779690779.076173:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503884928 00000100:00100000:3.0:1779690779.076287:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 480 00000100:00100000:3.0:1779690779.076293:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503884928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690779.076329:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30865e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503884928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690779.076335:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 480 00000100:00080000:1.0:1779690779.076471:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690779.080966:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690779.346152:0:79882:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690779.346160:0:79882:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690779.346780:0:79882:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690779.346790:0:79882:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690779.529039:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690779.529047:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690779.529840:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690779.529850:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690780.105437:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690780.553189:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690780.553198:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690780.553765:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690780.553774:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690780.802259:0:79933:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690780.802267:0:79933:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690780.802993:0:79933:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690780.803004:0:79933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690781.128996:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690781.577006:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690781.577015:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690781.577891:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690781.577901:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690781.640991:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1779690781.641014:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690781.641082:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690781.641162:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492403840:0@lo:400:kworker.0 00000100:00100000:0.0:1779690781.641193:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690781.641224:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1779690781.641238:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492403584:0@lo:400:kworker.0 00000100:00100000:0.0:1779690781.641245:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f81a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403968:0@lo:400:kworker.0 00000100:00100000:3.0:1779690781.641277:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690781.641306:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492404096:0@lo:400:kworker.0 00000100:00100000:0.0:1779690781.641311:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690781.641336:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690781.641357:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403968 00000100:00100000:3.0:1779690781.641359:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1779690781.641365:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403968 00000100:00100000:3.0:1779690781.641366:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492403712:0@lo:400:kworker.0 00000100:00100000:3.0:1779690781.641399:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690781.641417:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492404224:0@lo:400:kworker.0 00000100:00100000:3.0:1779690781.641438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690781.641463:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403840 00000100:00100000:3.0:1779690781.641467:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403840 00000100:00100000:3.0:1779690781.641508:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403712 00000100:00100000:3.0:1779690781.641511:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403712 00000100:00100000:3.0:1779690781.641544:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404224 00000100:00100000:3.0:1779690781.641548:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404224 00000100:00100000:3.0:1779690781.641563:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1779690781.641647:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404096 00000100:00100000:0.0:1779690781.641651:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404096 00000100:00100000:2.0:1779690781.641679:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1779690781.641689:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.641739:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492403712:12345-0@lo:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690781.641747:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1779690781.641765:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1779690781.641771:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492404224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.641796:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492404224:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690781.641801:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1779690781.641891:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403456 00000100:00100000:1.0:1779690781.641896:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403456 00000100:00100000:2.0:1779690781.641898:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f95b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492403712:0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.641912:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492404224:0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.641954:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:2.0:1779690781.641962:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492403968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690781.641993:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1779690781.642001:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492403968:12345-0@lo:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690781.642004:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492403456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690781.642016:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00002000:00000024:1.0:1779690781.642033:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690781.642067:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492403840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690781.642070:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1866137492403456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690781.642079:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00080000:1.0:1779690781.642099:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690781.642104:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690781.642107:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690781.642111:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30847d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492403840:12345-0@lo:400:kworker.0 Request processed in 539us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690781.642119:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1779690781.642151:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492403584 00000100:00100000:1.0:1779690781.642154:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690781.642156:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492403584 00000100:00100000:1.0:1779690781.642169:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492404352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690781.642187:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1779690781.642195:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492403584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690781.642201:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690781.642254:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492403584:12345-0@lo:400:kworker.0 Request processed in 60us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690781.642258:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404352 00000100:00100000:3.0:1779690781.642262:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1779690781.642263:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404352 00000100:00100000:1.0:1779690781.642291:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1779690781.642299:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492404352:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690781.642315:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492403584:0@lo:400:kworker.0 00002000:00000024:1.0:1779690781.642317:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690781.642355:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403968:0@lo:400:kworker.0 00000100:00100000:1.0:1779690781.642357:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492404352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690781.642365:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f81a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492403840:0@lo:400:kworker.0 00000100:00100000:1.0:1779690781.642366:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1779690781.642381:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492403456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690781.642406:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492404352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690781.643400:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:2.0:1779690781.643414:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.643472:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b4846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492404096:12345-0@lo:400:kworker.0 Request processed in 63us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690781.643530:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e308658b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492404096:0@lo:400:kworker.0 00000100:00100000:2.0:1779690781.644729:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00010000:00010000:2.0:1779690782.153262:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690782.321895:0:79984:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690782.321904:0:79984:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690782.322411:0:79984:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690782.322421:0:79984:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690782.601060:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690782.601070:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690782.601929:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690782.601944:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690783.177353:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690783.626877:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690783.626884:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690783.627445:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690783.627454:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690783.820564:0:80035:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690783.820573:0:80035:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690783.821426:0:80035:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690783.821436:0:80035:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690784.196302:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196343:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196449:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690784.196502:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886080 00000100:00100000:1.0:1779690784.196511:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886080 00000100:00100000:1.0:1779690784.196562:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886336 00000100:00100000:1.0:1779690784.196566:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886336 00000100:00100000:1.0:1779690784.196583:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885952 00000100:00100000:1.0:1779690784.196599:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885952 00000100:00100000:1.0:1779690784.196624:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886464 00000100:00100000:1.0:1779690784.196626:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886464 00000100:00100000:1.0:1779690784.196647:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3172 00000100:00100000:1.0:1779690784.196656:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503886080:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690784.196721:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503886080:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690784.196729:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3172 00000100:00100000:1.0:1779690784.196744:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3173 00000100:00100000:1.0:1779690784.196750:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503886336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690784.196772:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503886336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690784.196780:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3173 00000100:00100000:1.0:1779690784.196793:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3174 00000100:00100000:1.0:1779690784.196801:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503885952:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690784.196842:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3175 00000100:00100000:3.0:1779690784.196855:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503886464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690784.196858:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503885952:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690784.196868:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3174 00000100:00100000:1.0:1779690784.196893:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885824 00000100:00100000:3.0:1779690784.196898:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503886464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690784.196899:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885824 00000100:00100000:3.0:1779690784.196908:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3175 00000100:00100000:1.0:1779690784.196931:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886208 00000100:00100000:1.0:1779690784.196935:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886208 00000100:00080000:3.0:1779690784.196955:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690784.196961:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690784.196965:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 484 00000100:00080000:3.0:1779690784.196966:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690784.196975:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503885824:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690784.196984:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 485 00000100:00100000:3.0:1779690784.196995:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503886208:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690784.197004:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503885824:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690784.197017:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 484 00000100:00100000:3.0:1779690784.197030:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503886208:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690784.197038:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 485 00000100:00100000:0.0:1779690784.197359:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503885696 00000100:00100000:0.0:1779690784.197364:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503885696 00000100:00100000:0.0:1779690784.197409:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00100000:0.0:1779690784.197416:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503885696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690784.197443:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503885696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690784.197449:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 283 00010000:00010000:0.0:1779690784.201963:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690784.649056:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690784.649064:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690784.650650:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690784.650665:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690785.225995:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690785.265390:0:80087:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690785.265399:0:80087:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690785.266040:0:80087:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690785.266124:0:80087:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690785.673339:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690785.673348:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690785.675082:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690785.675099:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690786.249262:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690786.697040:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690786.697047:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690786.697593:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690786.697603:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690786.762346:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492404480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690786.762418:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690786.762505:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404480 00000100:00100000:1.0:1779690786.762512:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404480 00000100:00100000:1.0:1779690786.762571:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1779690786.762582:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492404480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690786.762617:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690786.762681:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492404608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690786.762686:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492404480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690786.762695:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1779690786.762719:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1779690786.762719:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1779690786.762857:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492405120:0@lo:400:kworker.0 00000100:00100000:3.0:1779690786.762889:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690786.762934:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690786.762941:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492404736:0@lo:400:kworker.0 00000100:00100000:3.0:1779690786.762967:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690786.763000:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404736 00000100:00100000:3.0:1779690786.763004:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404736 00000100:00100000:3.0:1779690786.763032:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1779690786.763039:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492404736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690786.763074:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3320:x1866137492404736:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690786.763081:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1779690786.763125:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3320:1866137492404736:0@lo:400:kworker.0 00000100:00100000:2.0:1779690786.763188:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405120 00000100:00100000:2.0:1779690786.763193:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405120 00000100:00100000:1.0:1779690786.766234:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404608 00000100:00100000:1.0:1779690786.766248:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404608 00000100:00100000:3.0:1779690786.766439:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1779690786.766451:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492405120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690786.766548:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492405120:12345-0@lo:400:kworker.0 Request processed in 101us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690786.766556:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1779690786.766606:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492405120:0@lo:400:kworker.0 00000100:00100000:1.0:1779690786.766762:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1779690786.766771:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492404608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690786.766799:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690786.766870:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492404608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690786.766876:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1779690786.766926:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492404864:0@lo:400:kworker.0 00000100:00100000:1.0:1779690786.766966:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690786.767008:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690786.767015:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492404992:0@lo:400:kworker.0 00000100:00100000:1.0:1779690786.767063:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690786.767091:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404864 00000100:00100000:1.0:1779690786.767095:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404864 00000100:00080000:2.0:1779690786.767353:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1779690786.767408:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690786.767493:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492404992 00000100:00100000:1.0:1779690786.767497:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492404992 00000100:00100000:2.0:1779690786.767540:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1779690786.767551:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690786.767598:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492404864:12345-0@lo:400:kworker.0 Request processed in 50us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690786.767605:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1779690786.767654:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492404864:0@lo:400:kworker.0 00000100:00080000:3.0:1779690786.767747:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1779690786.767855:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1779690786.767862:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492404992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690786.767904:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1866137492404992:12345-0@lo:400:kworker.0 Request processed in 42us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690786.767911:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1779690786.767995:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492404480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690786.768026:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bfc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1866137492404992:0@lo:400:kworker.0 00000100:00100000:1.0:1779690786.768051:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492404608:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1779690786.826577:0:80138:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690786.826590:0:80138:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690786.827380:0:80138:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690786.827399:0:80138:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690787.273019:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690787.721934:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690787.721941:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690787.722496:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690787.722508:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690788.300298:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690788.357176:0:80189:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690788.357185:0:80189:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690788.357741:0:80189:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690788.357752:0:80189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690788.745187:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690788.745195:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690788.745753:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690788.745763:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690789.312708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690789.312752:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690789.312909:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690789.312920:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886592 00000100:00100000:2.0:1779690789.312931:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886592 00000100:00100000:0.0:1779690789.312938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690789.312984:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 285 00000100:00100000:2.0:1779690789.312993:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503886592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690789.313202:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503886592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 210us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690789.313210:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 285 00000100:00100000:3.0:1779690789.313493:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887104 00000100:00100000:3.0:1779690789.313499:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887104 00000100:00100000:3.0:1779690789.313594:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 489 00000100:00100000:3.0:1779690789.313604:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503887104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690789.313640:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503887104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690789.313660:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 489 00000100:00080000:3.0:1779690789.313737:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690789.314615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690789.314636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690789.314672:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886848 00000100:00100000:1.0:1779690789.314687:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886848 00000100:00100000:1.0:1779690789.314728:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887360 00000100:00100000:1.0:1779690789.314732:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887360 00000100:00100000:1.0:1779690789.314751:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3176 00000100:00100000:1.0:1779690789.314760:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503886848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690789.314863:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886720 00000100:00100000:3.0:1779690789.314868:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886720 00000100:00100000:3.0:1779690789.314902:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 490 00000100:00100000:3.0:1779690789.314909:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503886720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690789.314958:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503886720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690789.314966:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 490 00000100:00100000:3.0:1779690789.314993:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3177 00000100:00100000:3.0:1779690789.315001:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503887360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690789.315029:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503887360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690789.315036:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3177 00000100:00080000:2.0:1779690789.315048:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690789.315053:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690789.315055:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690789.316720:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503886848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1954us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690789.316730:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3176 00000100:00100000:3.0:1779690789.317111:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503886976 00000100:00100000:0.0:1779690789.317118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690789.317120:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503886976 00000100:00100000:1.0:1779690789.317202:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887232 00000100:00100000:1.0:1779690789.317207:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887232 00000100:00100000:3.0:1779690789.317239:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3178 00000100:00100000:3.0:1779690789.317249:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503886976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690789.317298:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503886976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 51us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690789.317304:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3178 00000100:00080000:2.0:1779690789.317770:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690789.317781:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690789.317930:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3179 00000100:00100000:1.0:1779690789.317938:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503887232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690789.317984:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503887232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690789.317991:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3179 00010000:00010000:1.0:1779690789.321557:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690789.769046:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690789.769055:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690789.769669:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690789.769680:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690789.887036:0:80240:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690789.887044:0:80240:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690789.887903:0:80240:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690789.887913:0:80240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690790.344936:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690790.793492:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690790.793501:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690790.794151:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690790.794161:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690791.369744:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690791.430196:0:80291:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690791.430204:0:80291:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690791.431112:0:80291:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690791.431122:0:80291:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690791.817538:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690791.817546:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690791.818095:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690791.818105:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690791.881152:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492405376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690791.881215:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690791.881270:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492405888:0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.881417:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492405248:0@lo:400:kworker.0 00000100:00100000:0.0:1779690791.881428:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492405504:0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.881456:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690791.881484:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492405760:0@lo:400:kworker.0 00000100:00100000:3.0:1779690791.881536:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405248 00000100:00100000:0.0:1779690791.881539:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690791.881542:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492405632:0@lo:400:kworker.0 00000100:00100000:3.0:1779690791.881546:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405248 00000100:00100000:0.0:1779690791.881570:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492406016:0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.881578:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690791.881596:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1779690791.881604:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492405248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690791.881780:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690791.881892:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492406144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690791.881914:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690791.881949:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405504 00000100:00100000:2.0:1779690791.881954:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405504 00000100:00100000:0.0:1779690791.881967:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690791.881980:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492405248:12345-0@lo:400:kworker.0 Request processed in 374us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690791.881989:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1779690791.881999:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405632 00000100:00100000:2.0:1779690791.882003:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405632 00000100:00100000:0.0:1779690791.882016:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405888 00000100:00100000:0.0:1779690791.882022:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405888 00000100:00100000:3.0:1779690791.882037:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406016 00000100:00100000:3.0:1779690791.882043:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406016 00000100:00100000:0.0:1779690791.882064:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1779690791.882068:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1779690791.882074:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492405888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690791.882080:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492405504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.882093:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1779690791.882104:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492405632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690791.882137:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492405888:12345-0@lo:400:kworker.0 Request processed in 55us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690791.882146:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1779690791.882156:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492405504:12345-0@lo:400:kworker.0 Request processed in 77us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690791.882166:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1779690791.882174:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492405632:12345-0@lo:400:kworker.0 Request processed in 72us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690791.882188:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1779690791.882188:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405376 00000100:00100000:0.0:1779690791.882194:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405376 00000100:00100000:2.0:1779690791.882199:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1779690791.882213:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492406016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.882227:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406144 00000100:00100000:2.0:1779690791.882232:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406144 00000100:00100000:0.0:1779690791.882236:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:0.0:1779690791.882246:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492405376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690791.882252:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492406016:12345-0@lo:400:kworker.0 Request processed in 43us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690791.882261:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1779690791.882262:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1779690791.882274:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492406144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690791.882320:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492405504:0@lo:400:kworker.0 00000100:00100000:3.0:1779690791.882331:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492406016:0@lo:400:kworker.0 00002000:00000024:2.0:1779690791.882358:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00080000:3.0:1779690791.882360:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690791.882375:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690791.882379:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690791.882395:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492406144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690791.882403:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00002000:00000024:0.0:1779690791.882462:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690791.882502:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690791.882561:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492405376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 317us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690791.882568:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1779690791.882612:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492405248:0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.882631:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492405760 00000100:00100000:2.0:1779690791.882634:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492405760 00000100:00100000:3.0:1779690791.882648:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492405632:0@lo:400:kworker.0 00000100:00100000:2.0:1779690791.882664:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:2.0:1779690791.882672:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492405760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690791.882684:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492406144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690791.882713:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492405760:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690791.882720:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:3.0:1779690791.882732:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492405760:0@lo:400:kworker.0 00000100:00100000:1.0:1779690791.882784:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492405888:0@lo:400:kworker.0 00000100:00100000:1.0:1779690791.882821:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492405376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1779690792.394397:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690792.841024:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690792.841032:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690792.841642:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690792.841654:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690792.957041:0:80343:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690792.957049:0:80343:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690792.957743:0:80343:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690792.957753:0:80343:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690793.417104:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690793.865160:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690793.865168:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690793.865638:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690793.865646:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690794.433341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690794.433378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690794.433401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690794.433417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690794.435219:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887488 00000100:00100000:2.0:1779690794.435231:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887488 00000100:00100000:2.0:1779690794.435283:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:2.0:1779690794.435292:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503887488:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690794.435369:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503887488:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 77us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690794.435376:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:2.0:1779690794.435409:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888000 00000100:00100000:2.0:1779690794.435413:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888000 00000100:00100000:2.0:1779690794.435446:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 494 00000100:00100000:2.0:1779690794.435452:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503888000:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690794.435479:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503888000:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690794.435485:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 494 00000100:00080000:2.0:1779690794.435503:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1779690794.439952:0:80394:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690794.439967:0:80394:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1779690794.440500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690794.440535:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887616 00000100:00100000:3.0:1779690794.440543:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887616 00000100:00100000:3.0:1779690794.440596:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 495 00000100:00100000:3.0:1779690794.440605:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503887616:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690794.440686:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503887616:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690794.440694:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 495 00000100:00100000:3.0:1779690794.440736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000040:00080000:0.0:1779690794.441298:0:80394:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690794.441308:0:80394:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690794.441547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690794.441595:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887744 00000100:00100000:2.0:1779690794.441600:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887744 00000100:00100000:2.0:1779690794.441635:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888256 00000100:00100000:2.0:1779690794.441638:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888256 00000100:00100000:2.0:1779690794.441655:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503887872 00000100:00100000:2.0:1779690794.441657:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503887872 00000100:00100000:2.0:1779690794.441676:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3182 00000100:00100000:2.0:1779690794.441682:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503887744:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690794.441721:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503887744:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 39us (8342us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690794.441727:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3182 00000100:00100000:2.0:1779690794.441738:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3183 00000100:00100000:2.0:1779690794.441754:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503888256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690794.441778:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503888256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (8359us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690794.441784:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3183 00000100:00100000:2.0:1779690794.441794:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3184 00000100:00100000:2.0:1779690794.441800:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503887872:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690794.441836:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503887872:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690794.441842:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3184 00000100:00080000:2.0:1779690794.441857:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690794.441860:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690794.441863:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690794.441930:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1779690794.444071:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888128 00000100:00100000:0.0:1779690794.444080:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888128 00000100:00100000:0.0:1779690794.444147:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3185 00000100:00100000:0.0:1779690794.444156:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503888128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690794.444211:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503888128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 57us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690794.444218:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3185 00000100:00080000:3.0:1779690794.444699:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1779690794.889007:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690794.889016:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690794.889567:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690794.889577:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690795.467344:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690795.914004:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690795.914012:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690795.914596:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690795.914606:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690796.002844:0:80445:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690796.002853:0:80445:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690796.004454:0:80445:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690796.004469:0:80445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690796.489137:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690796.937748:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690796.937757:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690796.938503:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690796.938515:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690797.001219:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492406272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690797.001298:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690797.001334:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492406528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690797.001361:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690797.001385:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1779690797.001392:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492406400:0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001417:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406272 00000100:00100000:1.0:1779690797.001425:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690797.001426:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406272 00000100:00100000:3.0:1779690797.001434:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492406656:0@lo:400:kworker.0 00000100:00100000:3.0:1779690797.001476:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690797.001478:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690797.001484:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406528 00000100:00100000:1.0:1779690797.001487:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492406912:0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001488:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406528 00000100:00100000:3.0:1779690797.001507:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1779690797.001509:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1779690797.001513:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690797.001517:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492406784:0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001519:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492406272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690797.001548:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1779690797.001556:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492406528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1779690797.001558:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690797.001564:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1779690797.001573:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00080000:3.0:1779690797.001599:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690797.001604:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690797.001607:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492406528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690797.001614:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bfc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492406272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690797.001615:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1779690797.001618:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406400 00000100:00100000:0.0:1779690797.001621:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1779690797.001624:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406400 00000100:00100000:0.0:1779690797.001654:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406656 00000100:00100000:0.0:1779690797.001658:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406656 00000100:00100000:1.0:1779690797.001661:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492406528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690797.001665:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1779690797.001675:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492406400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001690:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406912 00000100:00100000:0.0:1779690797.001694:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406912 00000100:00100000:1.0:1779690797.001698:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492406784 00000100:00100000:1.0:1779690797.001700:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492406784 00000100:00100000:3.0:1779690797.001723:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492406400:12345-0@lo:400:kworker.0 Request processed in 50us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690797.001729:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1779690797.001734:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1779690797.001739:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1779690797.001739:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492406656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690797.001771:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1779690797.001781:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492406784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001786:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492406656:12345-0@lo:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690797.001800:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1779690797.001825:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690797.001843:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492406784:12345-0@lo:400:kworker.0 Request processed in 63us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690797.001851:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1779690797.001864:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492406912:12345-0@lo:400:kworker.0 Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690797.001871:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00080000:3.0:1779690797.001876:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690797.001897:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492406912:0@lo:400:kworker.0 00000100:00100000:0.0:1779690797.001912:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492406400:0@lo:400:kworker.0 00000100:00100000:3.0:1779690797.001961:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492406784:0@lo:400:kworker.0 00000100:00100000:3.0:1779690797.001973:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492406656:0@lo:400:kworker.0 00000100:00100000:2.0:1779690797.002180:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492406272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1779690797.519941:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690797.547547:0:80496:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690797.547556:0:80496:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690797.548140:0:80496:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690797.548151:0:80496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690797.963397:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690797.963406:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690797.964006:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690797.964017:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690798.537594:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690798.986000:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690798.986007:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690798.986555:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690798.986563:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690799.058231:0:80547:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690799.058238:0:80547:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690799.059041:0:80547:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690799.059051:0:80547:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690799.551890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.551934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.551971:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.552004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.552025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.552046:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.552100:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690799.552126:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888640 00000100:00100000:1.0:1779690799.552126:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888896 00000100:00100000:2.0:1779690799.552134:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888640 00000100:00100000:1.0:1779690799.552134:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888896 00000100:00100000:3.0:1779690799.552190:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889152 00000100:00100000:3.0:1779690799.552194:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889152 00000100:00100000:0.0:1779690799.552237:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888384 00000100:00100000:0.0:1779690799.552241:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888384 00000100:00100000:0.0:1779690799.552274:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:0.0:1779690799.552282:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503888384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690799.552342:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2390:x1866137503888384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 61us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690799.552349:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:0.0:1779690799.552376:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888512 00000100:00100000:0.0:1779690799.552379:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888512 00000100:00100000:2.0:1779690799.552524:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503888768 00000100:00100000:2.0:1779690799.552528:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503888768 00000100:00100000:2.0:1779690799.552548:0:15940:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889024 00000100:00100000:2.0:1779690799.552551:0:15940:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889024 00000100:00100000:2.0:1779690799.552568:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3186 00000100:00100000:2.0:1779690799.552575:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503888640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690799.552600:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 499 00000100:00100000:1.0:1779690799.552607:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503888896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690799.552614:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503888640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690799.552620:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3186 00000100:00100000:2.0:1779690799.552631:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3187 00000100:00100000:1.0:1779690799.552632:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503888896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690799.552637:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 499 00000100:00100000:2.0:1779690799.552644:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503888768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1779690799.552653:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690799.552662:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690799.552665:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690799.552666:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503888768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690799.552672:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3187 00000100:00100000:2.0:1779690799.552682:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3188 00000100:00100000:2.0:1779690799.552688:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503889024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690799.552708:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503889024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690799.552714:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3188 00000100:00100000:3.0:1779690799.553148:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3189 00000100:00100000:3.0:1779690799.553156:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503889152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690799.553191:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f95b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503889152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690799.553207:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3189 00000100:00100000:0.0:1779690799.553580:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 500 00000100:00100000:0.0:1779690799.553589:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503888512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690799.553738:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8ce12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2390:x1866137503888512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 150us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690799.553745:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 500 00010000:00010000:0.0:1779690799.561112:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690800.009277:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690800.009285:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690800.010233:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690800.010246:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690800.586602:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690800.602967:0:80599:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690800.602976:0:80599:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690800.603532:0:80599:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690800.603542:0:80599:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690801.034421:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690801.034429:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690801.035040:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690801.035050:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690801.611213:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690802.058533:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690802.058541:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690802.059440:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690802.059493:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690802.120990:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492407424:0@lo:400:kworker.0 00000100:00100000:2.0:1779690802.121061:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492407168:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.121070:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690802.121126:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1779690802.121133:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492407040:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.121177:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690802.121204:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492407552:0@lo:400:kworker.0 00000100:00100000:2.0:1779690802.121212:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690802.121236:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690802.121244:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492407680:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.121271:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492407296:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.121312:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690802.121332:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492407808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690802.121359:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690802.121366:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690802.121396:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407424 00000100:00100000:3.0:1779690802.121404:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407424 00000100:00100000:2.0:1779690802.121413:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407168 00000100:00100000:2.0:1779690802.121418:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407168 00000100:00100000:3.0:1779690802.121466:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407552 00000100:00100000:2.0:1779690802.121469:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407296 00000100:00100000:3.0:1779690802.121470:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407552 00000100:00100000:2.0:1779690802.121476:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407296 00000100:00100000:3.0:1779690802.121505:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1779690802.121514:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.121563:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492407424:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690802.121568:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407680 00000100:00100000:3.0:1779690802.121571:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1779690802.121574:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407680 00000100:00100000:3.0:1779690802.121596:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:2.0:1779690802.121601:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1779690802.121606:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492407552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690802.121613:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492407168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1779690802.121678:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690802.121684:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690802.121686:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690802.121885:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690802.121895:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492407936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690802.121969:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492407552:12345-0@lo:400:kworker.0 Request processed in 367us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690802.121980:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:2.0:1779690802.121980:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1866137492407168:12345-0@lo:400:kworker.0 Request processed in 368us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690802.121992:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1779690802.122004:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407040 00000100:00100000:3.0:1779690802.122009:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407040 00000100:00100000:2.0:1779690802.122012:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1779690802.122022:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492407296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122056:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1779690802.122062:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1866137492407168:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122068:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122105:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492407040:12345-0@lo:400:kworker.0 Request processed in 42us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690802.122111:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1779690802.122144:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1779690802.122150:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492407680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122198:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492407680:12345-0@lo:400:kworker.0 Request processed in 46us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690802.122199:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f81a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492407296:12345-0@lo:400:kworker.0 Request processed in 176us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690802.122211:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1779690802.122224:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1779690802.122231:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492407680:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122244:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407808 00000100:00100000:3.0:1779690802.122249:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407808 00000100:00100000:3.0:1779690802.122282:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1779690802.122289:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492407808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1779690802.122313:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690802.122384:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492407296:0@lo:400:kworker.0 00000100:00100000:3.0:1779690802.122421:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30ae762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492407808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690802.122429:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1779690802.122445:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492407808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690802.122473:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492407040:0@lo:400:kworker.0 00000100:00100000:0.0:1779690802.122540:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690802.122575:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492407552:0@lo:400:kworker.0 00000100:00100000:2.0:1779690802.122587:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492407424:0@lo:400:kworker.0 00000100:00100000:1.0:1779690802.122621:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492407936 00000100:00100000:1.0:1779690802.122626:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492407936 00000100:00100000:1.0:1779690802.122657:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1779690802.122665:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492407936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690802.122682:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690802.122725:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492407936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690802.122732:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1779690802.122779:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492407936:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1779690802.143849:0:80650:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690802.143856:0:80650:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690802.144654:0:80650:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690802.144765:0:80650:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690802.633019:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690803.081441:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690803.081524:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690803.082070:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690803.082079:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690803.657285:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690803.665668:0:80701:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690803.665677:0:80701:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690803.666253:0:80701:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690803.666262:0:80701:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690804.105017:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690804.105026:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690804.105553:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690804.105562:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690804.673407:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690804.673476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690804.673628:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889280 00000100:00100000:0.0:1779690804.673638:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889280 00000100:00100000:0.0:1779690804.673694:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 291 00000100:00100000:0.0:1779690804.673703:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503889280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690804.673770:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2391:x1866137503889280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690804.673778:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 291 00000100:00100000:3.0:1779690804.674496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690804.674560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690804.674577:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889536 00000100:00100000:2.0:1779690804.674583:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889536 00000100:00100000:2.0:1779690804.674635:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3192 00000100:00100000:2.0:1779690804.674642:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503889536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690804.674678:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b7a1272b-3551-4679-9948-3e2276470519+9:2391:x1866137503889536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690804.674685:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3192 00000100:00080000:0.0:1779690804.674783:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690804.674935:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889408 00000100:00100000:1.0:1779690804.674940:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889408 00000100:00100000:1.0:1779690804.674982:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 504 00000100:00100000:1.0:1779690804.674990:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503889408:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690804.675038:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7a1272b-3551-4679-9948-3e2276470519+63:2392:x1866137503889408:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690804.675044:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 504 00000100:00080000:0.0:1779690804.675100:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690804.675610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690804.675679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690804.675711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690804.675733:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889664 00000100:00100000:3.0:1779690804.675738:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889664 00000100:00100000:3.0:1779690804.675767:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889920 00000100:00100000:3.0:1779690804.675771:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889920 00000100:00100000:3.0:1779690804.675787:0:22279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890048 00000100:00100000:3.0:1779690804.675790:0:22279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890048 00000100:00100000:3.0:1779690804.675829:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3193 00000100:00100000:3.0:1779690804.675838:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503889664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690804.675874:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+13:2392:x1866137503889664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690804.675880:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3193 00000100:00100000:3.0:1779690804.675895:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3194 00000100:00100000:3.0:1779690804.675901:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503889920:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690804.675924:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+10:2392:x1866137503889920:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690804.675929:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3194 00000100:00100000:3.0:1779690804.675940:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3195 00000100:00100000:3.0:1779690804.675945:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503890048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690804.675981:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e775ff0e-5641-488a-99d7-1331a4992115+12:2391:x1866137503890048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690804.675987:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3195 00000100:00080000:3.0:1779690804.676007:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1779690804.676011:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690804.678436:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503889792 00000100:00100000:2.0:1779690804.678456:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503889792 00000100:00100000:2.0:1779690804.678970:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 505 00000100:00100000:2.0:1779690804.678979:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503889792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690804.679065:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2391:x1866137503889792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690804.679073:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 505 00000100:00080000:3.0:1779690804.679999:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690804.680959:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690805.132225:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690805.132234:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690805.132705:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690805.132713:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690805.160822:0:80752:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690805.160830:0:80752:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690805.163307:0:80752:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690805.163323:0:80752:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690805.705662:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690806.154539:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690806.154548:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690806.155798:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690806.155824:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690806.673964:0:80803:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690806.673973:0:80803:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690806.676086:0:80803:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690806.676105:0:80803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690806.730281:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690807.177096:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690807.177105:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690807.178784:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690807.178797:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690807.241078:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492408320:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241153:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690807.241221:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1779690807.241227:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492408192:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241251:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690807.241265:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492408704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241323:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690807.241356:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408320 00000100:00100000:0.0:1779690807.241364:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408320 00000100:00100000:0.0:1779690807.241411:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408192 00000100:00100000:0.0:1779690807.241414:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408192 00000100:00100000:0.0:1779690807.241442:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408704 00000100:00100000:0.0:1779690807.241445:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408704 00000100:00100000:0.0:1779690807.241460:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1779690807.241467:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492408320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241517:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1866137492408320:12345-0@lo:400:kworker.0 Request processed in 51us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690807.241523:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1779690807.241538:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1779690807.241543:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30b45f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492408192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241568:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30b45f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1866137492408192:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690807.241573:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1779690807.241583:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1779690807.241588:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492408704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241611:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1866137492408704:12345-0@lo:400:kworker.0 Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690807.241616:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00080000:0.0:1779690807.241635:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1779690807.241666:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1866137492408192:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241677:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1866137492408704:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241685:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1866137492408320:0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.241748:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492408832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690807.241772:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690807.241863:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492408064:0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.241901:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690807.241934:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492408448:0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.241944:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b45f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492408576:0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.241984:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690807.242039:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690807.242171:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408832 00000100:00100000:3.0:1779690807.242176:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408832 00000100:00100000:3.0:1779690807.242210:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1779690807.242219:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492408832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690807.242236:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408576 00000100:00100000:2.0:1779690807.242245:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408576 00002000:00000024:3.0:1779690807.242256:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690807.242295:0:10273:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408448 00000100:00100000:2.0:1779690807.242300:0:10273:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408448 00000100:00100000:3.0:1779690807.242308:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492408832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690807.242315:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00080000:3.0:1779690807.242344:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690807.242344:0:10273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00080000:3.0:1779690807.242352:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690807.242361:0:10273:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492408576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.242385:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492408832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690807.242437:0:10273:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492408576:12345-0@lo:400:kworker.0 Request processed in 82us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690807.242440:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1779690807.242453:0:10273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1779690807.242460:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492408448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690807.242520:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492408576:0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.242587:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1866137492408448:12345-0@lo:400:kworker.0 Request processed in 135us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690807.242594:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1779690807.242631:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1866137492408448:0@lo:400:kworker.0 00000100:00100000:3.0:1779690807.243050:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1779690807.243062:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492408960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690807.243092:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690807.243183:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408960 00000100:00100000:1.0:1779690807.243196:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408960 00000100:00100000:1.0:1779690807.243266:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1779690807.243273:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492408960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1779690807.243342:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690807.243385:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492408960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690807.243392:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1779690807.243434:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492408960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690807.243687:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492408064 00000100:00100000:0.0:1779690807.243692:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492408064 00000100:00100000:0.0:1779690807.243727:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1779690807.243733:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492408064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690807.243774:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492408064:12345-0@lo:400:kworker.0 Request processed in 41us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690807.243781:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1779690807.244509:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b45f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492408064:0@lo:400:kworker.0 00010000:00010000:3.0:1779690807.756683:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690808.149767:0:80855:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690808.149777:0:80855:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690808.151507:0:80855:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690808.151519:0:80855:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:3.0:1779690808.201237:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690808.201242:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690808.202362:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690808.202372:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690808.777062:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690809.225349:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690809.225357:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690809.226000:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690809.226010:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690809.664267:0:80906:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690809.664275:0:80906:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690809.664829:0:80906:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690809.664839:0:80906:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690809.792576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690809.792618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690809.792647:0:57551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890176 00000100:00100000:0.0:1779690809.792657:0:57551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890176 00000100:00100000:2.0:1779690809.792755:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890304 00000100:00100000:2.0:1779690809.792760:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890304 00000100:00100000:0.0:1779690809.792768:0:57551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:0.0:1779690809.792781:0:57551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503890176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690809.792852:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 509 00000100:00100000:2.0:1779690809.792859:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503890304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690809.792878:0:57551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503890176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690809.792887:0:57551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:2.0:1779690809.792892:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503890304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690809.792900:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 509 00000100:00080000:3.0:1779690809.792947:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690809.793520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690809.793582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690809.793651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690809.793667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1779690809.793712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690809.793770:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890560 00000100:00100000:3.0:1779690809.793774:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890560 00000100:00100000:3.0:1779690809.793834:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890816 00000100:00100000:3.0:1779690809.793838:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890816 00000100:00100000:3.0:1779690809.793865:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890432 00000100:00100000:3.0:1779690809.793867:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890432 00000100:00100000:3.0:1779690809.793881:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890944 00000100:00100000:3.0:1779690809.793883:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890944 00000100:00100000:3.0:1779690809.793900:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3198 00000100:00100000:3.0:1779690809.793906:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503890560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690809.793941:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2390:x1866137503890560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690809.793948:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3198 00000100:00100000:3.0:1779690809.793961:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3199 00000100:00100000:3.0:1779690809.793967:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503890816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690809.794003:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2390:x1866137503890816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690809.794009:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3199 00000100:00100000:3.0:1779690809.794029:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3200 00000100:00100000:3.0:1779690809.794035:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503890432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690809.794062:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+9:2390:x1866137503890432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690809.794068:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3200 00000100:00100000:3.0:1779690809.794077:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3201 00000100:00100000:3.0:1779690809.794082:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503890944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690809.794100:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+12:2390:x1866137503890944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 18us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690809.794105:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3201 00000100:00080000:2.0:1779690809.794355:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690809.794359:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690809.795642:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503890688 00000100:00100000:1.0:1779690809.795650:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503890688 00000100:00100000:1.0:1779690809.795713:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 510 00000100:00100000:1.0:1779690809.795722:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503890688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690809.795778:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2390:x1866137503890688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 58us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690809.795785:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 510 00000100:00080000:2.0:1779690809.796170:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1779690809.801002:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690810.249066:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690810.249073:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690810.249604:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690810.249614:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1779690810.825051:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690811.136703:0:80957:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690811.136711:0:80957:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690811.138465:0:80957:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690811.138477:0:80957:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690811.273034:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690811.273043:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690811.273648:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690811.273658:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1779690811.848926:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690812.297746:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690812.297753:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690812.300616:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690812.300631:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1779690812.361201:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690812.361266:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690812.361338:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409088 00000100:00100000:2.0:1779690812.361357:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409088 00000100:00100000:2.0:1779690812.361410:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1779690812.361418:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492409088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1779690812.361450:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:2.0:1779690812.361490:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492409088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690812.361497:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:2.0:1779690812.361516:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690812.361547:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1779690812.362246:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492409344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690812.362281:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690812.362311:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1779690812.362316:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492409216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690812.362338:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690812.362364:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409216 00000100:00100000:2.0:1779690812.362368:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409216 00000100:00100000:2.0:1779690812.362396:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1779690812.362402:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492409216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690812.362421:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1779690812.362453:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492409216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690812.362459:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00080000:2.0:1779690812.362476:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690812.362496:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492409216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690812.362526:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409344 00000100:00100000:2.0:1779690812.362529:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409344 00000100:00100000:2.0:1779690812.362562:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1779690812.362567:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690812.362600:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492409344:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690812.362607:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1779690812.362641:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492409344:0@lo:400:kworker.0 00000100:00100000:2.0:1779690812.366578:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492409472:0@lo:400:kworker.0 00000100:00100000:3.0:1779690812.366589:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492409728:0@lo:400:kworker.0 00000100:00100000:1.0:1779690812.366661:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492409600:0@lo:400:kworker.0 00000100:00100000:3.0:1779690812.367186:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690812.367264:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690812.367417:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409728 00000100:00100000:0.0:1779690812.367425:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409728 00000100:00100000:1.0:1779690812.367497:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690812.367560:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409472 00000100:00100000:3.0:1779690812.367565:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409472 00000100:00100000:1.0:1779690812.367567:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409600 00000100:00100000:1.0:1779690812.367573:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409600 00000100:00100000:3.0:1779690812.367615:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1779690812.367626:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1779690812.367628:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492409728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690812.367640:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492409472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690812.367685:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1866137492409728:12345-0@lo:400:kworker.0 Request processed in 62us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690812.367694:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1779690812.367705:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492409472:12345-0@lo:400:kworker.0 Request processed in 68us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690812.367713:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1779690812.367722:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1779690812.367731:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492409600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1779690812.367766:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690812.368135:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492409472:0@lo:400:kworker.0 00000100:00100000:2.0:1779690812.368175:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1866137492409728:0@lo:400:kworker.0 00000100:00100000:3.0:1779690812.368512:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1866137492409600:12345-0@lo:400:kworker.0 Request processed in 782us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690812.368520:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1779690812.368551:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1866137492409600:0@lo:400:kworker.0 00000040:00080000:0.0:1779690812.635342:0:81008:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690812.635351:0:81008:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690812.636106:0:81008:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690812.636115:0:81008:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690812.873005:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690813.321066:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690813.321074:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690813.321911:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690813.321921:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690813.896944:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690814.182344:0:81060:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690814.182353:0:81060:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690814.183588:0:81060:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690814.183600:0:81060:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690814.345153:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690814.345161:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690814.345733:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690814.345743:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690814.913557:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913664:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913697:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913769:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913791:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690814.913841:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891456 00000100:00100000:3.0:1779690814.913863:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891456 00000100:00100000:3.0:1779690814.913913:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891712 00000100:00100000:3.0:1779690814.913917:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891712 00000100:00100000:3.0:1779690814.913936:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891328 00000100:00100000:3.0:1779690814.913939:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891328 00000100:00100000:3.0:1779690814.913970:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891840 00000100:00100000:3.0:1779690814.913973:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891840 00000100:00100000:3.0:1779690814.913993:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3202 00000100:00100000:3.0:1779690814.914001:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503891456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690814.914065:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503891456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 64us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690814.914072:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3202 00000100:00100000:3.0:1779690814.914089:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3203 00000100:00100000:3.0:1779690814.914096:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2389:x1866137503891712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690814.914121:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e775ff0e-5641-488a-99d7-1331a4992115+10:2389:x1866137503891712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690814.914127:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3203 00000100:00100000:3.0:1779690814.914140:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3204 00000100:00100000:3.0:1779690814.914146:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3089592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503891328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690814.914170:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3089592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503891328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690814.914176:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3204 00000100:00100000:0.0:1779690814.914561:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3205 00000100:00100000:0.0:1779690814.914572:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503891840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690814.914693:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503891840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 123us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690814.914700:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3205 00000100:00100000:1.0:1779690814.914821:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891200 00000100:00100000:1.0:1779690814.914825:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891200 00000100:00100000:1.0:1779690814.914854:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891584 00000100:00100000:1.0:1779690814.914856:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891584 00000100:00100000:1.0:1779690814.914872:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 514 00000100:00100000:1.0:1779690814.914876:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503891200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690814.914905:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503891200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690814.914910:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 514 00000100:00100000:1.0:1779690814.914919:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 515 00000100:00100000:1.0:1779690814.914922:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503891584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690814.914933:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503891584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 11us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690814.914936:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 515 00000100:00100000:1.0:1779690814.914963:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891072 00000100:00100000:1.0:1779690814.914967:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891072 00000100:00100000:1.0:1779690814.914993:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00100000:1.0:1779690814.914998:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503891072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690814.915018:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e308479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503891072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 21us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690814.915023:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00080000:1.0:1779690814.915046:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1779690814.915050:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690814.915052:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1779690814.921023:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690815.369470:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690815.369477:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690815.370596:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690815.370620:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690815.706125:0:81111:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690815.706135:0:81111:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690815.706725:0:81111:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690815.706735:0:81111:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690815.945221:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690816.393455:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690816.393462:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690816.394021:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690816.394031:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690816.969044:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690817.266716:0:81162:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690817.266729:0:81162:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690817.268287:0:81162:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690817.268410:0:81162:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690817.418122:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690817.418130:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690817.418708:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690817.418717:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1779690817.481190:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690817.481214:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492410112:0@lo:400:kworker.0 00000100:00100000:3.0:1779690817.481237:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492410240:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.481287:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690817.481325:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410112 00000100:00100000:3.0:1779690817.481333:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410112 00000100:00100000:0.0:1779690817.481359:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492409856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690817.481388:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1779690817.481390:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690817.481413:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492410112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.481415:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492410624:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.481443:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690817.481486:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492410112:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.481512:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1779690817.481518:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492410496:0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.481692:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492409984:0@lo:400:kworker.0 00000100:00100000:1.0:1779690817.482491:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409856 00000100:00100000:1.0:1779690817.482496:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409856 00000100:00100000:1.0:1779690817.482535:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:1.0:1779690817.482544:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492409856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690817.482572:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:3.0:1779690817.484407:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492410112:12345-0@lo:400:kworker.0 Request processed in 2990us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690817.484420:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1779690817.484449:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410624 00000100:00100000:3.0:1779690817.484455:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410624 00000100:00100000:3.0:1779690817.484485:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1779690817.484492:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492410624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690817.484548:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492410624:12345-0@lo:400:kworker.0 Request processed in 56us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690817.484553:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00080000:3.0:1779690817.484575:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1779690817.484580:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1779690817.484599:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690817.484647:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492410752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690817.484677:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690817.484906:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690817.484937:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690817.484975:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492410368:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.484978:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492410624:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.485010:0:57585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410240 00000100:00100000:2.0:1779690817.485014:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690817.485015:0:57585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410240 00000100:00100000:0.0:1779690817.485056:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1779690817.485063:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.485116:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492410240:12345-0@lo:400:kworker.0 Request processed in 53us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690817.485122:0:6585:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410752 00000100:00100000:0.0:1779690817.485124:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1779690817.485128:0:6585:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410752 00000100:00080000:0.0:1779690817.485148:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1779690817.485152:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690817.485165:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1779690817.485172:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492410752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690817.485187:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410496 00000100:00100000:0.0:1779690817.485191:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410496 00002000:00000024:2.0:1779690817.485198:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1779690817.485217:0:6582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410368 00000100:00100000:0.0:1779690817.485221:0:6582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410368 00000100:00100000:2.0:1779690817.485240:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1866137492410752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690817.485245:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:2.0:1779690817.485253:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1779690817.485257:0:6582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.485275:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492409984 00000100:00100000:2.0:1779690817.485279:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492409984 00000100:00100000:2.0:1779690817.485298:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1779690817.485303:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492409984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.485330:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3084798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3321:x1866137492409984:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690817.485336:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1779690817.485358:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1779690817.485363:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.485395:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492410368:12345-0@lo:400:kworker.0 Request processed in 33us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690817.485401:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1779690817.485429:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3321:1866137492409984:0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.485444:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492410368:0@lo:400:kworker.0 00000100:00100000:0.0:1779690817.485449:0:6582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492410496:12345-0@lo:400:kworker.0 Request processed in 194us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690817.485456:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:0.0:1779690817.485489:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492410496:0@lo:400:kworker.0 00000100:00100000:2.0:1779690817.485931:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492410752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1779690817.485942:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492410240:0@lo:400:kworker.0 00000100:00100000:1.0:1779690817.486643:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492409856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4098us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690817.486652:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1779690817.486733:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492409856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1779690817.993953:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690818.441964:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690818.442039:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690818.444222:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690818.444236:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690818.805070:0:81213:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690818.805077:0:81213:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690818.806054:0:81213:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690818.806065:0:81213:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690819.017042:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690819.465073:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690819.465080:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690819.465641:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690819.465648:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690820.032160:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690820.032205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690820.032247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690820.032280:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892224 00000100:00100000:0.0:1779690820.032289:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892224 00000100:00100000:3.0:1779690820.032339:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690820.032394:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503891968 00000100:00100000:1.0:1779690820.032398:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503891968 00000100:00100000:1.0:1779690820.032428:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 297 00000100:00100000:1.0:1779690820.032438:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503891968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690820.032501:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2389:x1866137503891968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690820.032507:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 297 00000100:00100000:0.0:1779690820.032643:0:49882:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892736 00000100:00100000:0.0:1779690820.032647:0:49882:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892736 00000100:00100000:1.0:1779690820.032663:0:22279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3208 00000100:00100000:3.0:1779690820.032694:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690820.032755:0:22279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503892224:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690820.032791:0:22279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b7a1272b-3551-4679-9948-3e2276470519+9:2389:x1866137503892224:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 122us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690820.033168:0:49882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3209 00000100:00100000:0.0:1779690820.033178:0:49882:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503892736:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690820.033179:0:22279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3208 00000100:00080000:1.0:1779690820.033200:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1779690820.033204:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1779690820.033206:0:49882:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e775ff0e-5641-488a-99d7-1331a4992115+12:2389:x1866137503892736:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690820.033212:0:49882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3209 00000100:00100000:3.0:1779690820.033382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690820.033405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690820.033428:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892352 00000100:00100000:3.0:1779690820.033432:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892352 00000100:00100000:3.0:1779690820.033457:0:6583:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892608 00000100:00100000:3.0:1779690820.033459:0:6583:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892608 00000100:00100000:3.0:1779690820.033477:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3210 00000100:00100000:3.0:1779690820.033495:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503892352:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690820.033522:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7a1272b-3551-4679-9948-3e2276470519+13:2389:x1866137503892352:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690820.033528:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3210 00000100:00100000:3.0:1779690820.033541:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3211 00000100:00100000:3.0:1779690820.033547:0:6583:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2389:x1866137503892608:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690820.033572:0:6583:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e775ff0e-5641-488a-99d7-1331a4992115+10:2389:x1866137503892608:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 20us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690820.033579:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3211 00000100:00080000:1.0:1779690820.033642:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1779690820.033645:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1779690820.034107:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892480 00000100:00100000:2.0:1779690820.034113:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892480 00000100:00080000:1.0:1779690820.034197:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690820.036941:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892096 00000100:00100000:2.0:1779690820.036952:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892096 00000100:00100000:1.0:1779690820.037591:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 519 00000100:00100000:1.0:1779690820.037673:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503892480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690820.037753:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e775ff0e-5641-488a-99d7-1331a4992115+68:2389:x1866137503892480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (5503us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690820.037763:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 519 00000100:00100000:1.0:1779690820.037789:0:57585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 520 00000100:00100000:1.0:1779690820.037798:0:57585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3090a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503892096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690820.037840:0:57585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3090a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7a1272b-3551-4679-9948-3e2276470519+63:2389:x1866137503892096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 44us (5144us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690820.037847:0:57585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 520 00000100:00080000:1.0:1779690820.037871:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1779690820.042095:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690820.271092:0:81265:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690820.271100:0:81265:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690820.271659:0:81265:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690820.271668:0:81265:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690820.490319:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690820.490330:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690820.491433:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690820.491449:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690821.065016:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690821.513184:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690821.513193:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690821.514785:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690821.514796:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:1.0:1779690821.754508:0:81317:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690821.754517:0:81317:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690821.755152:0:81317:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690821.755161:0:81317:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690822.089082:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1779690822.537446:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690822.537914:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690822.538868:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690822.538889:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690822.601290:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492411136:0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.601361:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690822.601424:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492411648:0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.601446:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690822.601480:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411136 00000100:00100000:1.0:1779690822.601485:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1779690822.601488:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411136 00000100:00100000:1.0:1779690822.601490:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3090a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492411008:0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.601516:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690822.601539:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492411520:0@lo:400:kworker.0 00000100:00100000:3.0:1779690822.601546:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411648 00000100:00100000:3.0:1779690822.601549:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411648 00000100:00100000:1.0:1779690822.601563:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690822.601570:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1779690822.601578:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.601589:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1779690822.601596:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492411648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690822.601669:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1779690822.601685:0:57554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411008 00000100:00100000:0.0:1779690822.601695:0:57554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411008 00000100:00100000:0.0:1779690822.601728:0:57554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1779690822.601734:0:57554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492411008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1779690822.602124:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1866137492411136:12345-0@lo:400:kworker.0 Request processed in 545us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690822.602132:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1779690822.602168:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492411264:0@lo:400:kworker.0 00000100:00100000:2.0:1779690822.602205:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690822.602212:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1779690822.602232:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492411392:0@lo:400:kworker.0 00000100:00100000:3.0:1779690822.602259:0:64445:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411264 00000100:00100000:3.0:1779690822.602263:0:64445:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411264 00000100:00100000:3.0:1779690822.602288:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1779690822.602294:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.602630:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1866137492411648:12345-0@lo:400:kworker.0 Request processed in 1033us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690822.602631:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690822.602642:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1779690822.602671:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411520 00000100:00100000:1.0:1779690822.602675:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411520 00000100:00100000:1.0:1779690822.602706:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411392 00000100:00100000:1.0:1779690822.602710:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411392 00000100:00100000:2.0:1779690822.602714:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492410880 00000100:00100000:2.0:1779690822.602720:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492410880 00000100:00100000:1.0:1779690822.602737:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1779690822.602745:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492411520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690822.602756:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1779690822.602766:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1866137492410880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690822.602783:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1866137492411520:12345-0@lo:400:kworker.0 Request processed in 38us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690822.602790:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00002000:00000024:2.0:1779690822.602796:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690822.602820:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:1.0:1779690822.602830:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492411392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.602893:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492411392:12345-0@lo:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690822.602894:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492410880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690822.602906:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:2.0:1779690822.602910:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1779690822.603035:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492411776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690822.603064:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690822.603100:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411776 00000100:00100000:1.0:1779690822.603104:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411776 00000100:00080000:2.0:1779690822.604010:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1779690822.604016:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1779690822.604020:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690822.604039:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1779690822.604050:0:6585:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aeae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492411776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1779690822.604075:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1779690822.604083:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492411520:0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.604101:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1866137492411136:0@lo:400:kworker.0 00000100:00100000:1.0:1779690822.604115:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30ae656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1866137492411648:0@lo:400:kworker.0 00000100:00100000:2.0:1779690822.604138:0:6585:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aeae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492411776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690822.604148:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1779690822.604186:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492411776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690822.604310:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1779690822.604425:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492411392:0@lo:400:kworker.0 00000100:00100000:2.0:1779690822.605205:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492411264:12345-0@lo:400:kworker.0 Request processed in 2908us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690822.605214:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1779690822.605404:0:57554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3319:x1866137492411008:12345-0@lo:400:kworker.0 Request processed in 3669us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690822.605413:0:57554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1779690822.605516:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30b43f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492411264:0@lo:400:kworker.0 00000100:00100000:3.0:1779690822.605593:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3090a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3319:1866137492411008:0@lo:400:kworker.0 00010000:00010000:2.0:1779690823.123095:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690823.291829:0:81368:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690823.291836:0:81368:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690823.292399:0:81368:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690823.292409:0:81368:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:0.0:1779690823.561133:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1779690823.561140:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1779690823.564773:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:0.0:1779690823.564791:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1779690824.137047:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690824.586242:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690824.586251:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690824.586788:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690824.586800:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690824.820510:0:81419:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690824.820518:0:81419:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690824.821735:0:81419:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690824.821748:0:81419:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1779690825.152184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690825.152243:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690825.152356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690825.152385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690825.152447:0:57561:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892992 00000100:00100000:0.0:1779690825.152459:0:57561:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892992 00000100:00100000:0.0:1779690825.152539:0:57561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 524 00000100:00100000:0.0:1779690825.152551:0:57561:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503892992:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1779690825.152645:0:57561:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f82994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7a1272b-3551-4679-9948-3e2276470519+63:2391:x1866137503892992:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 96us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690825.152655:0:57561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 524 00000100:00080000:0.0:1779690825.152684:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1779690825.153040:0:57555:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503892864 00000100:00100000:2.0:1779690825.153052:0:57555:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503892864 00000100:00100000:2.0:1779690825.153122:0:57555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 299 00000100:00100000:2.0:1779690825.153133:0:57555:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503892864:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690825.153210:0:57555:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:578be135-92a0-4fb4-90ad-98e1a6d14d2e+12:2392:x1866137503892864:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690825.153219:0:57555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 299 00000100:00100000:0.0:1779690825.154450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1779690825.154463:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503893248 00000100:00100000:1.0:1779690825.154471:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503893248 00000100:00100000:1.0:1779690825.154530:0:22747:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503893504 00000100:00080000:3.0:1779690825.154534:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690825.154534:0:22747:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503893504 00000100:00080000:3.0:1779690825.154551:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1779690825.154566:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3214 00000100:00100000:1.0:1779690825.154576:0:22747:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503893248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690825.154584:0:15940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3215 00000100:00100000:3.0:1779690825.154598:0:15940:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503893504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1779690825.154631:0:22747:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b7a1272b-3551-4679-9948-3e2276470519+13:2391:x1866137503893248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 56us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690825.154641:0:15940:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30bf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e775ff0e-5641-488a-99d7-1331a4992115+10:2391:x1866137503893504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690825.154641:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3214 00000100:00100000:3.0:1779690825.154652:0:15940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3215 00000100:00100000:0.0:1779690825.156547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1779690825.156662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1779690825.156749:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503893120 00000100:00100000:3.0:1779690825.156759:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503893120 00000100:00100000:3.0:1779690825.156834:0:6581:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503893632 00000100:00100000:3.0:1779690825.156838:0:6581:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503893632 00000100:00100000:3.0:1779690825.156871:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3216 00000100:00100000:3.0:1779690825.156881:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503893120:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690825.156949:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7a1272b-3551-4679-9948-3e2276470519+9:2392:x1866137503893120:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690825.156956:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3216 00000100:00100000:3.0:1779690825.156986:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3217 00000100:00100000:3.0:1779690825.156993:0:6581:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503893632:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1779690825.157020:0:6581:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e775ff0e-5641-488a-99d7-1331a4992115+12:2392:x1866137503893632:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690825.157027:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3217 00000100:00080000:0.0:1779690825.157507:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1779690825.157512:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690825.159053:0:57560:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137503893376 00000100:00100000:2.0:1779690825.159066:0:57560:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137503893376 00000100:00100000:2.0:1779690825.159198:0:57560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 525 00000100:00100000:2.0:1779690825.159209:0:57560:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503893376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1779690825.159289:0:57560:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e775ff0e-5641-488a-99d7-1331a4992115+68:2392:x1866137503893376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 82us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690825.159297:0:57560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 525 00000100:00080000:3.0:1779690825.160623:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1779690825.161050:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690825.609307:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690825.609319:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690825.609885:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690825.609897:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690826.184934:0:5783:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1779690826.372186:0:81470:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1779690826.372196:0:81470:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1779690826.373364:0:81470:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:1.0:1779690826.373374:0:81470:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000040:00080000:2.0:1779690826.633039:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690826.633047:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690826.633786:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690826.633795:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:2.0:1779690827.209070:0:7463:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1779690827.659112:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1779690827.659120:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1779690827.659631:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:2.0:1779690827.659641:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1779690827.720986:0:3321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30aee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492411904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1779690827.721069:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690827.721155:0:6584:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492411904 00000100:00100000:1.0:1779690827.721162:0:6584:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492411904 00000100:00100000:3.0:1779690827.721254:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492412032:0@lo:400:kworker.0 00000100:00100000:1.0:1779690827.721288:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1779690827.721294:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690827.721303:0:6584:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492411904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1779690827.721329:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e2f89d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492412544:0@lo:400:kworker.0 00002000:00000024:1.0:1779690827.721337:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 743636992 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1779690827.721360:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1779690827.721382:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1779690827.721384:0:6584:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1866137492411904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690827.721389:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492412160:0@lo:400:kworker.0 00000100:00100000:1.0:1779690827.721396:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1779690827.721432:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690827.721446:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492412288:0@lo:400:kworker.0 00000100:00100000:3.0:1779690827.721468:0:57576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412032 00000100:00100000:3.0:1779690827.721473:0:57576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412032 00000100:00100000:1.0:1779690827.721478:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690827.721482:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3086587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492412672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1779690827.721506:0:57576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1779690827.721507:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1779690827.721517:0:57576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492412032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1779690827.721517:0:3320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e30bf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492412416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690827.721525:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1779690827.721555:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1779690827.721570:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412544 00000100:00100000:0.0:1779690827.721575:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412544 00000100:00100000:1.0:1779690827.721589:0:40949:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412416 00000100:00100000:1.0:1779690827.721594:0:40949:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412416 00000100:00100000:0.0:1779690827.721611:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412160 00000100:00100000:0.0:1779690827.721615:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412160 00000100:00100000:1.0:1779690827.721630:0:40949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:1.0:1779690827.721638:0:40949:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690827.721651:0:57559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412288 00000100:00100000:0.0:1779690827.721655:0:57559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412288 00000100:00100000:0.0:1779690827.721678:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1779690827.721686:0:40949:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3320:x1866137492412416:12345-0@lo:400:kworker.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690827.721687:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492412544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1779690827.721688:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1779690827.721695:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1779690827.721702:0:40949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00080000:2.0:1779690827.721708:0:5789:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1779690827.721729:0:64445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1779690827.721734:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1866137492412544:12345-0@lo:400:kworker.0 Request processed in 48us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1779690827.721742:0:64445:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492412160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1779690827.721743:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1779690827.721751:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1866137492412416:0@lo:400:kworker.0 00000100:00100000:0.0:1779690827.721763:0:57559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1779690827.721773:0:57559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e30aee3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492412288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1779690827.721792:0:64445:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f89d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1866137492412160:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690827.721794:0:27580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866137492412672 00000100:00100000:1.0:1779690827.721800:0:27580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866137492412672 00000100:00100000:2.0:1779690827.721823:0:64445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1779690827.721850:0:57559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e30aee3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1866137492412288:12345-0@lo:400:kworker.0 Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1779690827.721857:0:57559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1779690827.721887:0:3321:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30aee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1866137492411904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1779690827.721895:0:3320:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1866137492412288:0@lo:400:kworker.0 00000100:00100000:2.0:1779690827.721931:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1866137492412160:0@lo:400:kworker.0 00000100:00100000:2.0:1779690827.721943:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e2f89d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1866137492412544:0@lo:400:kworker.0 00000100:00100000:3.0:1779690827.722259:0:57576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2f8433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6a3f5053-4ad1-4edd-9178-035bb14fcf26+18:3318:x1866137492412032:12345-0@lo:400:kworker.0 Request processed in 746us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1779690827.722266:0:57576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1779690827.722331:0:3318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e30bf4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a3f5053-4ad1-4edd-9178-035bb14fcf26:3318:1866137492412032:0@lo:400:kworker.0 00000100:00100000:1.0:1779690827.723942:0:27580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1779690827.723951:0:27580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3086587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492412672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1779690827.723991:0:27580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 622657536 pending 0 free 3760193536 avail 3758096384 00000100:00100000:1.0:1779690827.724052:0:27580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3086587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1866137492412672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1779690827.724060:0:27580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1779690827.724466:0:3319:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e3086587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1866137492412672:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1779690828.190006:0:81520:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_251: @@@@@@ FAIL: request on 0x200000bd3:0x34:0x0 is not STARTED on mds1 00010000:00010000:2.0:1779690828.234068:0:5782:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1779690828.681566:0:57595:0:(llog.c:800:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1779690828.681573:0:57595:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1779690828.682189:0:57595:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 64768 count 1 00000040:00080000:3.0:1779690828.682197:0:57595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 Debug log: 49138 lines, 49138 kept, 0 dropped, 0 bad.